-- Logs begin at Fri 2022-08-05 06:31:18 UTC, end at Fri 2022-08-05 07:39:09 UTC. -- Aug 05 07:05:17.967882 dv-cinder-852007-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 07:05:17.978421 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 07:05:17 2022] *** Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: nodename: dv-cinder-852007-1-iscsi Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: machine: x86_64 Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: clock source: unix Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: pcre jit disabled Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: detected number of CPU cores: 4 Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: current working directory: / Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: detected binary path: /usr/bin/uwsgi-core Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: your processes number limit is 47680 Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: your memory page size is 4096 bytes Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: detected max file descriptor number: 2048 Aug 05 07:05:17.981252 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: lock engine: pthread robust mutexes Aug 05 07:05:17.982160 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: thunder lock: enabled Aug 05 07:05:17.982160 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 07:05:17.982160 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 07:05:18.022485 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: Python main interpreter initialized at 0x55672c58f9c0 Aug 05 07:05:18.022485 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: python threads support enabled Aug 05 07:05:18.022485 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: your server socket listen backlog is limited to 100 connections Aug 05 07:05:18.022485 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: your mercy for graceful operations on workers is 90 seconds Aug 05 07:05:18.023047 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 07:05:18.023047 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: *** Operational MODE: preforking *** Aug 05 07:05:18.023253 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: *** uWSGI is running in multiple interpreter mode *** Aug 05 07:05:18.023253 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: spawned uWSGI master process (pid: 103405) Aug 05 07:05:18.023447 dv-cinder-852007-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 07:05:18.024011 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: spawned uWSGI worker 1 (pid: 103406, cores: 1) Aug 05 07:05:18.028925 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: spawned uWSGI worker 2 (pid: 103407, cores: 1) Aug 05 07:05:18.028925 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 07:05:18.739087 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 07:05:18.932788 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 07:05:19.930325 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 07:05:19.930325 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: from cryptography.utils import int_from_bytes Aug 05 07:05:19.931425 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 07:05:19.931425 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: from cryptography.utils import int_from_bytes Aug 05 07:05:20.000539 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 07:05:20.000539 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: from cryptography.utils import int_from_bytes Aug 05 07:05:20.001491 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 07:05:20.001491 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: from cryptography.utils import int_from_bytes Aug 05 07:05:22.455061 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 07:05:22.455979 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 07:05:22.455979 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 07:05:22.456751 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 07:05:22.456751 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 07:05:22.457065 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 07:05:22.457199 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 07:05:22.457338 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 07:05:22.457480 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 07:05:22.457611 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 07:05:22.457760 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.457888 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.458025 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.458163 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.458292 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.458419 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.458607 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.458742 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.458871 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.459011 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.459154 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.459281 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.459409 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.459544 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.459667 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.459790 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.459928 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.460052 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.460174 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.460313 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.460440 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.460575 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.460830 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852007-1-iscsi {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.460998 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852007-1-iscsi {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.461116 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.461244 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.461368 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.461496 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.461637 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.461762 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.461896 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.462022 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.462163 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.462309 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.462438 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.462564 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.462689 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.462825 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.462951 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.463113 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.463113 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.463355 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.463482 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.463611 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.463719 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.463863 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.464000 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.464137 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.464266 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.464392 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.464887 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.465461 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.465461 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.465805 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.466016 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.466216 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.466359 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.466577 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.466775 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.466974 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.467136 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852007-1-iscsi {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.467289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852007-1-iscsi {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.467444 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.467759 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.467916 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.468071 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.468218 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.468381 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.468534 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.468704 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.468858 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.469128 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.469326 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.469486 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.469631 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.469777 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.469920 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.470062 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.470208 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.470374 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.470531 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.470679 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.470803 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.470917 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.471136 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.471281 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.471448 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.471592 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.471737 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.471900 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.472039 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.472226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.472356 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.472485 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.472641 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.472802 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.473002 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.473148 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.473290 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.473434 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.473586 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.473729 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.473890 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.474047 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.474190 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.474312 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.474431 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.474586 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.474741 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.474893 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.475038 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.475183 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.475349 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.475496 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.475609 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.475691 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.475838 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.475983 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.476148 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.476367 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.476538 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.476682 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.476825 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.476998 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.477296 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.477447 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.477605 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.477744 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.477941 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.478112 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.478263 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.478411 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.478549 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.478695 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.478839 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.479005 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.479153 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.479297 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.479505 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.479655 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.479795 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.479954 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.480104 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.480246 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.480370 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.480507 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.480672 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.480839 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.480996 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.481139 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.481282 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.481426 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.481592 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.481752 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.481897 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.482040 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.482174 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.482311 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.482469 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.482608 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.482747 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.482884 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.483023 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.483160 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.483313 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.483450 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.483590 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.483730 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.483884 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.484030 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.484195 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.484195 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.484471 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.484471 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.484736 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.484934 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.485072 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.485206 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.485346 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.485482 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.485687 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.485849 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.485986 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.486135 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.486275 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.486469 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.486613 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.486765 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.486917 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.487066 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.487214 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.487429 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.487580 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.487580 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.487860 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.488003 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.488153 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.488308 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.488460 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.488629 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.488783 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.488984 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.489132 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.489274 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.489435 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.489650 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.489809 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.489951 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.490108 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.490253 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.490411 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.490553 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.490697 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.490898 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.491058 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.491200 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.491363 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.491508 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.491673 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.491816 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.491961 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.492119 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.492263 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.492522 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.492675 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.492828 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.493101 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.493262 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.493428 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.493582 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.493739 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.493894 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.494047 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.494192 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.494348 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.494489 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.494643 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.494785 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.494930 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.495073 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.495231 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.495385 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.495538 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.495681 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.495822 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.495964 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.496120 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.496264 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.496417 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.496614 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.496772 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.496969 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.497128 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.497275 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.497419 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.497613 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.497762 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.497931 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.498076 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.498287 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.498434 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.498579 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.498720 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.498878 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.499030 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.499174 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.499319 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.499471 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.499614 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.499829 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.499989 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.500134 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.500278 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.500430 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.500588 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:05:22.500730 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.501050 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.501197 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.501341 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.501485 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.501647 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.501792 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.501935 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.502078 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.502221 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.502363 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.502527 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.502653 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.502778 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.502981 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.503124 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.503283 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.503429 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.503573 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.503573 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.503837 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.503979 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.504136 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.504278 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.504419 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.504561 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.504704 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.504846 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.505071 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.505230 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.505376 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.505527 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.505669 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.505811 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.505968 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.506128 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.506270 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.506417 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.506560 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.506756 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.506918 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.507061 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.507209 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.507356 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.507513 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.507657 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.507797 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.507936 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.508098 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.508244 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.508381 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.508644 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.508789 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.508983 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.509145 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.509289 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.509442 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.509600 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.509744 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.509956 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.510113 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.510255 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.510399 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.510555 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.510701 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.510843 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.511029 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.511229 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.511390 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.511546 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.511690 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.511823 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.512024 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.512188 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.512326 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.512481 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.512631 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.512774 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.512942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.513086 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.513270 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.513417 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.513559 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.513701 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.513826 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.513953 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.514103 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.514261 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.514405 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.514562 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.514719 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.514865 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.515124 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.515271 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.515415 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.515601 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.515732 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.515866 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.516019 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.516173 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.516328 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.516463 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.516600 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.516750 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.516888 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.517225 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.517383 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.517536 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.517677 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.517828 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.517950 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.518085 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.518224 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.518361 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.518501 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.518650 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.518802 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.518943 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.519103 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.519245 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.519389 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.519544 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.519686 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.519839 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.519978 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.520172 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.520343 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.520484 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.520624 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.520764 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.520926 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.521050 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.521206 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.521346 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.521497 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.521657 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.521657 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.521898 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.522063 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.522205 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.522353 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.522515 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.522652 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.522802 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.522957 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.523100 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.523232 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.523363 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.523498 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.523652 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.523793 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.523936 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.524087 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.524239 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.524381 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.524532 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.524679 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.524829 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.525086 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.525227 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.525364 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.525517 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.525659 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.525798 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.525939 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.526079 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.526217 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.526375 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.526513 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.526668 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.526872 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.527065 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.527231 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.527373 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.527520 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.527671 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.527826 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.528318 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.528463 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.528600 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.528764 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.528930 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.529074 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.529214 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.529384 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.529531 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.529672 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.529815 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.529956 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.530100 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.530269 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.530361 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.530429 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.530494 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.530557 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.530639 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.530727 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.530795 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.530859 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.530923 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.531001 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.531119 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.531246 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.531390 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.531533 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.531675 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.531815 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.531971 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.532128 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.532281 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.532420 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.532562 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.532702 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.532864 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.533068 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.533234 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.533376 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.533515 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.533667 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.533818 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.533958 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.534098 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.534302 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.534452 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.534605 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.534758 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.534898 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.535052 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.535207 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.535347 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.535501 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.535656 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.535809 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.535953 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.536104 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.536255 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.536408 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.536571 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.536713 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.536851 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.537020 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.537216 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.537382 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.537539 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.537688 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.537828 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.537970 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.538127 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.538264 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.538402 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.538594 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.538752 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.538957 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.539116 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.539378 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.539485 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.539571 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.539699 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.539807 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.539920 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.540063 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.540204 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.540344 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.540470 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.540594 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.540737 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.540915 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.541064 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.541222 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.541382 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.541537 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.541681 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.541825 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.541966 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.542107 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.542249 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.542515 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.542515 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.542797 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.542797 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.543022 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.543137 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.543229 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.543319 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.543455 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.543599 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.543742 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.543881 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.544036 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.544036 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.544304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.544448 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.544592 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.544748 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.544913 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.545078 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.545226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.545373 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.545469 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.545548 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.545624 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.545728 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.545872 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.546016 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.546158 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.546311 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.546468 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.546610 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.546765 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.546885 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.547027 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.547185 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.547372 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.547522 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.547660 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.547798 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.547941 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.548095 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.548239 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.548385 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.548531 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.548688 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.548831 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.549058 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.549274 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.549421 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.549564 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.549677 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.549836 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.549980 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.550120 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.550264 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.550408 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.550600 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.550758 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.550914 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.551052 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.551159 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.551235 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.551300 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.551384 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.551465 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.551602 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.551761 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.551905 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.552066 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.552220 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.552361 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.552505 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.552648 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.552793 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.552965 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.553114 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.553241 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.553374 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.553531 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.553676 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.553834 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.553977 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.554119 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.554264 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.554409 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.554565 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.554733 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.554876 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.555033 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.555178 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.555337 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.555494 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.555650 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.555795 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.555939 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.556079 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.556217 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.556360 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.556506 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.556618 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.556688 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.556752 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.556854 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.557110 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.557258 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.557398 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.557603 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.557749 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.557891 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.558048 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.558048 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.558308 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.558460 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.558603 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.558759 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.558954 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.559112 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.559302 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.559302 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.559571 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.559728 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.559871 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.560022 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.560143 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.560270 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.560391 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.560530 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.560665 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.560787 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.560875 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.561106 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.561237 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.561380 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.561380 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.561380 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.561760 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.561913 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.562073 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.562236 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.562393 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.562393 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.562393 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.562806 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.562942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.563032 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.563136 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.563216 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.563297 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.563363 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.563476 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.563616 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.563758 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.564015 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.564171 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.564315 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.564459 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.564599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.564762 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.564925 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.565088 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.565211 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.565355 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.565487 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.565644 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.565786 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.565926 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.566080 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.566232 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.566394 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.566552 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.566696 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.566838 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.566991 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.567139 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.567295 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.567427 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.567568 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.567766 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.567926 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.568072 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.568235 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.568377 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.568521 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.568641 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.568721 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.568801 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.568878 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.569203 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.569352 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.569546 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.569696 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.569858 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.570001 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.570128 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.570273 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.570382 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.570540 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.570698 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.570881 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.571042 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.571179 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.571325 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.571467 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.571612 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.571758 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.571897 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.572041 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.572041 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.572295 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.572428 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.572572 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.572725 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.572870 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.573039 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.573203 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.573370 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.573498 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.573572 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.573645 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.573720 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.573828 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.574139 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.574284 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.574441 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.574588 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.574748 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.574878 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.575020 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.575162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.575304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.575450 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.575609 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.575752 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.575899 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.576044 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.576190 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.576345 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.576504 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.576647 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.576791 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.576958 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.577082 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.577224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.577391 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.577536 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.577682 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.577822 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.577960 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.578101 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.578216 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.578286 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.578351 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.578420 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.578559 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.578720 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.578865 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.579008 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.579167 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.579367 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.579492 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.579690 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.579829 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.579973 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.580112 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.580248 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.580402 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.580560 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.580708 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.580853 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.581179 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.581328 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.581494 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.581711 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.581866 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.582008 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.582159 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.582313 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.582471 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.582618 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.582770 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.582926 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.583081 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.583212 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.583368 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.583522 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.583668 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.583810 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.583954 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.584096 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.584264 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.584394 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.584481 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.584548 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.584612 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.584687 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.584755 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.584832 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.584938 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.585010 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.585075 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.585168 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.585257 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.585331 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.585470 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.585665 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.585860 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.586027 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.586170 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.586862 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.587043 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.587209 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.587354 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.587509 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.587652 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.587793 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.587935 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.588125 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.588285 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.588423 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.588575 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.588716 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.588869 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.589091 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.589265 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.589420 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.589547 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.589674 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.589865 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.590010 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.590165 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.590319 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.590461 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.590603 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.590741 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.590892 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.591157 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.591355 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.591491 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.591635 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.591766 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.591915 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.592065 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.592207 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.592345 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.592497 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.592641 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.592800 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.593031 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.593176 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.593335 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.593477 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.593616 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.593774 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.593919 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.594025 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.594093 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.594167 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.594265 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.594367 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.594515 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.594670 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.594814 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.594956 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.595097 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.595255 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.595255 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.595530 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.595530 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.595794 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.595794 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.596065 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.596220 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.596364 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.596504 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.596646 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.596803 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.596968 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.597137 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.597282 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.597414 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.597502 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.597502 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.597635 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.597708 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.597807 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.597962 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.598125 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.598319 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.598466 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.598611 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.598779 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.598926 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.599085 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.599085 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.599354 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.599498 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.599694 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.599847 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.599989 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.599989 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.600240 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.600394 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.600537 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.600694 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.600852 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.601119 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.601264 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.601433 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.601590 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.601700 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.601845 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.601845 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.602152 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.602341 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.602485 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.602641 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.602787 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.602930 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.603059 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.603265 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.603410 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.603566 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.603710 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.603849 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.603993 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.604140 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.604254 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.604254 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.604538 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.604681 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.604825 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.604990 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.605136 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.605296 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.605440 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.605574 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.605662 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.605729 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.605804 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.605878 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.605943 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.606035 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.606177 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.606320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.606472 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.606669 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.606828 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.606971 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.607120 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.607267 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.607408 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.607559 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.607849 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.608018 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.608164 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.608310 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.608450 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.608577 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.608742 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.608888 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.609149 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.609292 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.609438 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.609584 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.609728 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.609856 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.609983 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.610201 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.610351 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.610351 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.610627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.610774 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.610916 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.611008 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.611121 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.611337 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.611483 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.611622 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.611765 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.611931 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.612162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.612162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.612445 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.612586 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.612740 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.612882 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.613069 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.613230 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.613375 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.613516 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.613671 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.613815 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.614052 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.614209 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.614355 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.614498 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.614638 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.614782 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.614942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.615085 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.615240 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.615393 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.615539 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.615705 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.615859 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.616000 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.616141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.616283 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.616428 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.616588 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.616730 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.616876 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.617054 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.617145 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.617214 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.617295 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.617386 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.617463 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.617587 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.617788 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.617946 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.618104 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.618248 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.618389 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.618532 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.618661 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.618784 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.618939 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.619097 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.619266 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.619363 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.619483 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.619621 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.619807 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.620015 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.620165 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.620360 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.620508 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.620673 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.620818 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.621053 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.621200 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.621369 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.621514 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.621657 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.621783 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.621910 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.622038 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.622186 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.622329 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.622484 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.622629 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.622774 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.622932 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.623025 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.623151 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.623258 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.623401 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.623545 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.623689 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.623832 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.623990 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.624137 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.624292 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.624412 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.624556 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.624690 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.624857 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.625084 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.625226 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.625373 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.625535 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.625680 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.625845 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.625993 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.626136 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.626280 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.626422 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.626576 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.626711 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.626882 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.627029 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.627176 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.627324 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.627586 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.627744 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.627860 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.627930 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.627995 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.628071 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.628169 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.628310 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.628453 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.628608 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.628808 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.629038 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.629210 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.629355 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.629500 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.629639 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.629787 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.629955 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.630156 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.630307 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.630504 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.630655 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.630800 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.630957 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.631105 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.631261 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.631373 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.631505 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.631652 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.631812 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.631942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.632070 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.632206 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.632364 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.632525 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.632687 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.632788 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.632945 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.633097 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.633258 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.633456 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.633619 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.633762 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.633937 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.634239 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.634394 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.634549 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.634697 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.634842 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.634986 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.635133 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.635294 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.635455 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.635605 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.635760 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.635904 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.636048 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.636214 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.636358 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.636512 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.636657 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.636802 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.637054 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.637231 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.637384 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.637532 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.637689 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.637834 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.637992 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.638112 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.638247 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.638392 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.638538 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.638693 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.638850 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.638977 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.639104 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.639258 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.639398 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.639540 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.639702 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.639856 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.639966 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.640039 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.640174 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.640437 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.640615 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.640757 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.640884 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.641047 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.641175 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.641329 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.641452 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.641807 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.641954 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.642082 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.642213 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.642362 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.642499 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.642631 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.642789 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.642920 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.643221 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.643373 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.643533 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.643667 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.643796 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.643939 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.643939 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.644218 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.644512 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.644663 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.644805 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.645035 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.645163 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.645291 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.645446 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.645591 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.645736 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.645893 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.646036 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.646179 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.646179 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.646444 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.646547 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.646633 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.646701 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.646896 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.646987 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.647223 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.647378 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.647544 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.647685 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.647826 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.647968 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.648870 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.649175 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.649175 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.649550 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.649550 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.649905 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.650050 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.650214 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.650358 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.650358 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.650589 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.650716 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.650907 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.651069 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.651216 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.651358 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.651499 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.651639 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.651789 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.651947 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.652101 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.652248 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.652372 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.652372 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.652618 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.652775 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.653302 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.653444 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.653581 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.653721 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.653885 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.654027 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.654168 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.654309 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.654452 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.654606 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.654763 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.654904 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.655049 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.655205 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.655205 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.655362 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.655440 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.655517 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.655618 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.655763 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.655907 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.656060 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.656321 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.656527 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.656673 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.656820 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.657043 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.657206 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.657352 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.657496 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.657639 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.657784 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.657928 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.658084 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.658235 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.658379 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.658547 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.658687 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.658832 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.658990 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.659122 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.659212 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.659290 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.659357 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.659422 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.659497 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.659572 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.659639 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.659704 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.659769 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.659968 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.660048 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.660264 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.660397 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.660578 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.660703 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.660876 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.661087 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.661246 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.661389 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.661544 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.661660 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.661842 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.661931 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.662139 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.662228 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.662448 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.662563 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.662750 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.662857 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.663071 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.663224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.663364 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.663470 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.663714 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.663941 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.664098 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.664267 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.664414 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.664618 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.664738 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.664958 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.665052 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.665280 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.665422 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.665563 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.665671 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.665864 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.665989 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.666158 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.666459 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.666558 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.666772 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.666917 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.667074 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.667193 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.667381 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.667532 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.667679 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.667820 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.667968 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.668073 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.668263 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.668354 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.668567 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.668655 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.668871 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.669042 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.669235 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.669379 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.669509 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.669643 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.669771 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.669875 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.670071 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.670158 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.670380 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.670521 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.670660 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.670809 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.670959 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.671074 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.671255 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.671343 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.671559 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.671657 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.671865 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.672029 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.672173 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.672353 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.672544 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.672635 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.672762 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.672872 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.673089 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.673227 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.673396 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.673548 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.673697 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.673788 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.674003 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.674099 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.674325 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.674441 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.674635 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.674800 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.674935 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.675057 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.675232 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.675321 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.675542 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.675688 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.675843 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.676005 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.676152 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.676298 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.676454 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.676618 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.676765 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.676958 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.677104 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.677250 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.677402 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.677543 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.677712 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.677882 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.678042 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.678188 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.678333 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.678485 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.678663 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.678813 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.678943 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.679043 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.679263 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.679399 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.679542 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.679682 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.679829 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.679974 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.680120 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.680328 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.680523 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.680613 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.680842 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.681019 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.681161 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.681412 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.681563 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.681713 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.681870 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.682015 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.682162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.682324 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.682468 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.682681 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.682828 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.682990 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.683108 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.683197 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.683334 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.683476 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.683607 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.683740 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.683990 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.684130 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.684268 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.684412 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.684560 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.684705 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.684873 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.685046 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.685190 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.685334 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.685480 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.685668 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.685769 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.685847 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.685921 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.685988 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.686117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.686260 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.686419 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.686565 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.686710 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.686854 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.686999 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.687141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.687289 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.687427 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.687573 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.687711 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.687852 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.688005 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.688174 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.688324 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.688472 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.688620 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.688767 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.688951 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.689096 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.689232 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.689375 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.689520 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.689706 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.689930 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.690082 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.690231 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.690376 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.690514 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.690668 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.690807 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.690946 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.691073 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.691407 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.691555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.691711 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.691871 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.692014 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.692159 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.692298 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.692438 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.692593 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.692818 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.693024 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.693172 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.693313 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.693469 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.693603 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.693690 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.693812 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.693957 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.694100 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.694259 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.694403 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.694564 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.694718 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.694864 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.695004 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.695119 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.695204 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.695287 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.695355 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.695430 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.695510 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.695591 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.695730 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.695928 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.696076 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.696241 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.696380 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.696562 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.696711 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.696852 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.697101 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.697264 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.697430 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.697572 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.697711 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.697853 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.697995 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.698139 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.698293 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.698434 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.698573 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.698714 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.698867 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.699021 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.699164 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.699316 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.699466 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.699606 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.699756 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.699910 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.700048 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.700174 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.700328 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.700470 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.700644 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.700807 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.701037 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.701232 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.701397 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.701542 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.701672 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.701823 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.701987 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 07:05:22.702129 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.702271 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.702590 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.702932 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.703257 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.703568 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.703876 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.704183 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:05:22.704423 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 07:05:22.860802 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Registered counter for database nova_api Aug 05 07:05:22.862564 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO dbcounter [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Registered counter for database nova_api Aug 05 07:05:22.883654 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_db.sqlalchemy.engines [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:05:22.886432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:05:22.890621 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writer thread running {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:05:22.896179 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:05:22.947706 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.context [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4447999f-53a9-44bb-be53-fbe9a3e421dd(cell1) {{(pid=103406) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 07:05:22.951700 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:05:22.952168 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:05:22.953781 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:05:22.954524 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:05:22.954965 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:05:22.957019 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:05:22.957373 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.context [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4447999f-53a9-44bb-be53-fbe9a3e421dd(cell1) {{(pid=103407) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 07:05:22.959103 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO dbcounter [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Registered counter for database nova_cell0 Aug 05 07:05:22.961376 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:05:22.961963 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:05:22.963581 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:05:22.964348 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:05:22.964799 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:05:22.965257 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO dbcounter [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Registered counter for database nova_cell1 Aug 05 07:05:22.966881 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:05:22.968984 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Registered counter for database nova_cell0 Aug 05 07:05:22.973912 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_db.sqlalchemy.engines [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:05:22.975166 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Registered counter for database nova_cell1 Aug 05 07:05:22.975702 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_db.sqlalchemy.engines [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:05:22.982131 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writer thread running {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:05:22.984029 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writer thread running {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:05:22.984230 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:05:22.987667 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:05:22.991496 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:05:22.998229 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:05:23.141909 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Registered counter for database nova_cell0 Aug 05 07:05:23.144469 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO dbcounter [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Registered counter for database nova_cell0 Aug 05 07:05:23.151913 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:05:23.153548 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_db.sqlalchemy.engines [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:05:23.158487 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writer thread running {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:05:23.158636 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:05:23.499985 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: WARNING keystonemiddleware.auth_token [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 07:05:23.508011 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: WARNING keystonemiddleware.auth_token [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 07:05:23.513658 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 07:05:23.521738 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 07:05:23.863850 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: WARNING keystonemiddleware.auth_token [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 07:05:23.870221 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: WARNING keystonemiddleware.auth_token [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 07:05:23.874585 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 07:05:23.875705 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55672c58f9c0 pid: 103406 (default app) Aug 05 07:05:23.877999 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:05:23.879217 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001937 Aug 05 07:05:23.879644 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Fri Aug 5 07:05:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:05:23.880809 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-33ce8b3d-a281-4543-aaa3-c07ed2c90353 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 07:05:23.886410 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55672c58f9c0 pid: 103407 (default app) Aug 05 07:06:49.978385 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:06:49.982044 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004230 Aug 05 07:06:49.982821 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:06:50.011112 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:50.012870 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell0:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:50.014049 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell1:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:50.015297 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:51.160116 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-36455466-424a-4880-bdcd-57d0734ca782 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:06:51.198901 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-36455466-424a-4880-bdcd-57d0734ca782 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.203664 Aug 05 07:06:51.202408 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Fri Aug 5 07:06:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:06:53.649617 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:06:53.650633 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-dd9205bf-93b7-4345-a210-49e2c7e80bcd None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 05 07:06:53.651015 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:06:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:06:54.265739 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-d82b2fb9-453e-4da5-80eb-7e8a12838510 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:06:54.295811 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:06:54.295811 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: warnings.warn(msg) Aug 05 07:06:54.332165 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-d82b2fb9-453e-4da5-80eb-7e8a12838510 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.674157 Aug 05 07:06:54.333326 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 5 07:06:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:06:54.559861 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-f6cffa8c-c0a6-4c3d-ad6b-a376b6d064b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:06:54.564337 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:06:54.564337 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: warnings.warn(msg) Aug 05 07:06:54.584597 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=3 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:54.585898 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell0:SELECT=3 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:54.586280 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell1:SELECT=3 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:54.587220 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:54.635998 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-f6cffa8c-c0a6-4c3d-ad6b-a376b6d064b5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293076 Aug 05 07:06:54.637029 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Aug 5 07:06:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:06:57.060747 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-d82b2fb9-453e-4da5-80eb-7e8a12838510 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:06:57.063355 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-d82b2fb9-453e-4da5-80eb-7e8a12838510 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003280 Aug 05 07:06:57.064142 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:06:57.949277 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-abe9b521-967f-4177-821a-df96e19be144 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "ram": 512}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:06:57.968786 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:06:57.968786 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: warnings.warn(msg) Aug 05 07:06:58.006927 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-abe9b521-967f-4177-821a-df96e19be144 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.934229 Aug 05 07:06:58.008278 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 5 07:06:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:06:58.032310 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-39ae3199-7f6e-49ec-8328-9b1dfd1dc343 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:06:58.043538 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:06:58.043538 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: warnings.warn(msg) Aug 05 07:06:58.089455 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-39ae3199-7f6e-49ec-8328-9b1dfd1dc343 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067470 Aug 05 07:06:58.097096 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Aug 5 07:06:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:07:00.575344 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-abe9b521-967f-4177-821a-df96e19be144 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:00.576383 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-abe9b521-967f-4177-821a-df96e19be144 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 05 07:07:00.577288 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:07:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:01.082798 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f1d8b2db-f045-469d-8ad0-9c27ed423235 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:01.105258 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f1d8b2db-f045-469d-8ad0-9c27ed423235 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514793 Aug 05 07:07:01.105841 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 5 07:07:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 07:07:01.119335 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-aeb61490-ecc2-4d71-a68e-28b3e499b6c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:01.150151 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-aeb61490-ecc2-4d71-a68e-28b3e499b6c5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034654 Aug 05 07:07:01.151254 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Aug 5 07:07:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:07:03.891383 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f1d8b2db-f045-469d-8ad0-9c27ed423235 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:03.892314 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f1d8b2db-f045-469d-8ad0-9c27ed423235 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 05 07:07:03.892712 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:07:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:04.535254 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-3d0b4666-832c-4129-8f3c-f47f5e883eb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:04.561404 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-3d0b4666-832c-4129-8f3c-f47f5e883eb9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.658021 Aug 05 07:07:04.562105 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 5 07:07:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:07:04.579411 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-3d11007f-a9ab-48bf-95ad-01577ab59fed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:04.617247 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-3d11007f-a9ab-48bf-95ad-01577ab59fed admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044534 Aug 05 07:07:04.618034 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Aug 5 07:07:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:07:07.287607 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-3d0b4666-832c-4129-8f3c-f47f5e883eb9 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:07.288620 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-3d0b4666-832c-4129-8f3c-f47f5e883eb9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 05 07:07:07.289403 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:07:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:07.940910 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f1a2e324-9b41-4fc5-b45e-0e4d542a39cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "id": "d4"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:07.978452 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f1a2e324-9b41-4fc5-b45e-0e4d542a39cc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.681605 Aug 05 07:07:07.985032 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 5 07:07:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 07:07:08.000330 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-fcdca261-2e9f-4f64-aa64-8cfdd21599b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:08.028601 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-fcdca261-2e9f-4f64-aa64-8cfdd21599b2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035160 Aug 05 07:07:08.029213 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Aug 5 07:07:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:07:10.719756 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f1a2e324-9b41-4fc5-b45e-0e4d542a39cc admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:10.720818 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f1a2e324-9b41-4fc5-b45e-0e4d542a39cc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Aug 05 07:07:10.721543 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:07:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:11.333984 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-b59f969d-acc9-4658-8c24-446c52859f53 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:11.362142 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-b59f969d-acc9-4658-8c24-446c52859f53 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.633068 Aug 05 07:07:11.362837 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Fri Aug 5 07:07:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:07:14.472757 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f1a2e324-9b41-4fc5-b45e-0e4d542a39cc admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:14.473856 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f1a2e324-9b41-4fc5-b45e-0e4d542a39cc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Aug 05 07:07:14.474253 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:07:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:07:15.112062 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-78ee0ffa-673c-4eeb-851a-98391671d1bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:15.136731 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-78ee0ffa-673c-4eeb-851a-98391671d1bc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.652410 Aug 05 07:07:15.137711 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 5 07:07:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:07:15.154721 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-7ab3f266-c9ec-43ed-acc6-6cf5af15dd73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:15.186467 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-7ab3f266-c9ec-43ed-acc6-6cf5af15dd73 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036657 Aug 05 07:07:15.187354 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Aug 5 07:07:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:07:17.543908 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-78ee0ffa-673c-4eeb-851a-98391671d1bc admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:17.545077 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-78ee0ffa-673c-4eeb-851a-98391671d1bc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 05 07:07:17.545553 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:07:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:18.036507 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f54f09a3-5377-4c55-b2c8-90dc1370d321 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:18.058377 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f54f09a3-5377-4c55-b2c8-90dc1370d321 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.505731 Aug 05 07:07:18.058948 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 5 07:07:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:07:18.077061 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-ee37be32-06bf-4c9d-8219-c316093fd06b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:18.106761 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-ee37be32-06bf-4c9d-8219-c316093fd06b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034178 Aug 05 07:07:18.107730 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Aug 5 07:07:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:07:20.518354 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f54f09a3-5377-4c55-b2c8-90dc1370d321 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:20.520148 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f54f09a3-5377-4c55-b2c8-90dc1370d321 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002331 Aug 05 07:07:20.520781 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:07:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:07:21.109116 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-6c846fbd-9f9f-4938-ac69-d25ed7ed5992 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "disk": 40, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:21.131684 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-6c846fbd-9f9f-4938-ac69-d25ed7ed5992 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.603727 Aug 05 07:07:21.132233 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 5 07:07:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 07:07:21.154585 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-9607ff12-7fe3-40ba-bb24-3656a1229df8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:21.163137 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:21.203719 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-9607ff12-7fe3-40ba-bb24-3656a1229df8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055904 Aug 05 07:07:21.204753 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Aug 5 07:07:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:07:23.490821 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-6c846fbd-9f9f-4938-ac69-d25ed7ed5992 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:23.491849 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-6c846fbd-9f9f-4938-ac69-d25ed7ed5992 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 05 07:07:23.492242 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:07:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:24.015457 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-a863e20c-c2e3-491f-aaed-939397f0131a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:24.038999 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-a863e20c-c2e3-491f-aaed-939397f0131a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.540324 Aug 05 07:07:24.040209 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 5 07:07:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 07:07:24.055564 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-56540fdf-0420-4962-bf8b-b9248517bce4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:24.081337 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-56540fdf-0420-4962-bf8b-b9248517bce4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029467 Aug 05 07:07:24.082675 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Aug 5 07:07:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:07:26.364344 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-a863e20c-c2e3-491f-aaed-939397f0131a admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:26.365624 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-a863e20c-c2e3-491f-aaed-939397f0131a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 Aug 05 07:07:26.366218 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:07:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:07:26.941907 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-d283756a-41de-4fda-9b7e-04595237498d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:26.966101 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-d283756a-41de-4fda-9b7e-04595237498d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.592293 Aug 05 07:07:26.973048 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Aug 5 07:07:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:07:26.984005 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b5213c44-e408-4667-afc0-d427ba3b7ad1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:27.014527 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-b5213c44-e408-4667-afc0-d427ba3b7ad1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035997 Aug 05 07:07:27.015534 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Aug 5 07:07:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:07:46.033824 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-d283756a-41de-4fda-9b7e-04595237498d admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:46.034831 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-d283756a-41de-4fda-9b7e-04595237498d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 05 07:07:46.035222 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:07:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:46.046086 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:46.489081 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-031a67c5-2570-4722-a837-f7de768df04e admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:46.508643 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-031a67c5-2570-4722-a837-f7de768df04e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.467073 Aug 05 07:07:46.509233 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Fri Aug 5 07:07:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:07:47.630985 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-d283756a-41de-4fda-9b7e-04595237498d admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:47.631986 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-d283756a-41de-4fda-9b7e-04595237498d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 05 07:07:47.632374 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 5 07:07:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:48.182024 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-5d3acf6e-0057-40fb-8a4d-deddf75388d4 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:48.188102 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-5d3acf6e-0057-40fb-8a4d-deddf75388d4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-5d3acf6e-0057-40fb-8a4d-deddf75388d4 admin admin] Request method failure captured: Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Accept: application/json Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Connection: keep-alive Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Content-Length: 0 Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Host: 10.222.0.27 Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABi7MHDkxUaMd7VOCoTlUmnBD6KEJ6nwjvuB2RNPU9umkplSgVe0d67artB1NDSq7b6UKmzDJnlS0oddmol8iaL3s_HRxKYGLLy5KDXkV9WcIfAUu_cYCsSu-Nc_tIIW3yz5mIUYnPkyXlQ4OjjyKfozzDTumrWKSAcJ-k89_Ez8RMSDak Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Domain-Id: None Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Domain-Name: None Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Project-Id: c0ce80734b754922ab08055a8061587e Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Project-Name: admin Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Role: admin,member,reader Aug 05 07:07:48.191415 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Roles: admin,member,reader Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0ce80734b754922ab08055a8061587e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0ce80734b754922ab08055a8061587e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0ce80734b754922ab08055a8061587e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0ce80734b754922ab08055a8061587e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Tenant: admin Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Tenant-Id: c0ce80734b754922ab08055a8061587e Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User: admin Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User-Id: 1acd68042e0349f6afed23e5889b5da6 Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User-Name: admin Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: method: > Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: exception: Flavor 42 could not be found. Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: action_args: {'id': '42'} Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:07:48.193110 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:07:48.194117 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:48.195432 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-5d3acf6e-0057-40fb-8a4d-deddf75388d4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:07:48.196745 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-5d3acf6e-0057-40fb-8a4d-deddf75388d4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.421709 Aug 05 07:07:48.196745 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Fri Aug 5 07:07:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:48.202655 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-e17068ae-069a-4f42-935e-7491cfa0f2a6 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:48.206761 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:48.226469 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-e17068ae-069a-4f42-935e-7491cfa0f2a6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027335 Aug 05 07:07:48.226997 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Aug 5 07:07:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:07:48.237097 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-075a35e4-fba5-4f62-9ff3-ff5640b83f72 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:48.261472 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-075a35e4-fba5-4f62-9ff3-ff5640b83f72 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028166 Aug 05 07:07:48.262025 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Aug 5 07:07:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:07:48.272565 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-485ea57a-dfae-462d-bcf3-5f85c9a60cb7 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:48.279296 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.wsgi [None req-485ea57a-dfae-462d-bcf3-5f85c9a60cb7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-485ea57a-dfae-462d-bcf3-5f85c9a60cb7 admin admin] Request method failure captured: Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Accept: application/json Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Accept-Encoding: gzip, deflate Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Connection: keep-alive Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Content-Length: 0 Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Host: 10.222.0.27 Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Openstack-Api-Version: compute 2.90 Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Openstack-System-Scope: None Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: User-Agent: python-novaclient Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Auth-Token: gAAAAABi7MHDkxUaMd7VOCoTlUmnBD6KEJ6nwjvuB2RNPU9umkplSgVe0d67artB1NDSq7b6UKmzDJnlS0oddmol8iaL3s_HRxKYGLLy5KDXkV9WcIfAUu_cYCsSu-Nc_tIIW3yz5mIUYnPkyXlQ4OjjyKfozzDTumrWKSAcJ-k89_Ez8RMSDak Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Domain-Id: None Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Domain-Name: None Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Identity-Status: Confirmed Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Is-Admin-Project: True Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Project-Domain-Id: default Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Project-Domain-Name: Default Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Project-Id: c0ce80734b754922ab08055a8061587e Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Project-Name: admin Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Role: admin,member,reader Aug 05 07:07:48.282846 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Roles: admin,member,reader Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0ce80734b754922ab08055a8061587e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0ce80734b754922ab08055a8061587e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0ce80734b754922ab08055a8061587e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0ce80734b754922ab08055a8061587e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Tenant: admin Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Tenant-Id: c0ce80734b754922ab08055a8061587e Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Tenant-Name: admin Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User: admin Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User-Domain-Id: default Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User-Domain-Name: Default Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User-Id: 1acd68042e0349f6afed23e5889b5da6 Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User-Name: admin Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: method: > Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: exception: Flavor 42 could not be found. Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: action_args: {'id': '42'} Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:07:48.284141 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:07:48.285226 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:48.286528 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-485ea57a-dfae-462d-bcf3-5f85c9a60cb7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:07:48.287709 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-485ea57a-dfae-462d-bcf3-5f85c9a60cb7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016140 Aug 05 07:07:48.287709 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Fri Aug 5 07:07:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:49.256422 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-075a35e4-fba5-4f62-9ff3-ff5640b83f72 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:49.257469 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-075a35e4-fba5-4f62-9ff3-ff5640b83f72 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 05 07:07:49.257864 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 5 07:07:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:49.812279 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-67133bc9-b119-45a0-85ab-6344a474dce6 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:49.818459 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.wsgi [None req-67133bc9-b119-45a0-85ab-6344a474dce6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-67133bc9-b119-45a0-85ab-6344a474dce6 admin admin] Request method failure captured: Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Accept: application/json Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Accept-Encoding: gzip, deflate Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Connection: keep-alive Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Content-Length: 0 Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Host: 10.222.0.27 Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Openstack-Api-Version: compute 2.90 Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Openstack-System-Scope: None Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: User-Agent: python-novaclient Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Auth-Token: gAAAAABi7MHFqVI2u2WRA1zslbSWQi-D6jbAU0kM9SGjhuTkBIyFIB_1Z86f4DG5SBOvmbVkeqAEVW4NmljXtmOxpEATFmrJsE_6Yqjo-FFALeiqJ1BfDurGITL_0dqrw5xc4yJLyT2XsMoLsrL1J-DL61rYxrfLl2F-on2_cW21dZs3_FucatU Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Domain-Id: None Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Domain-Name: None Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Identity-Status: Confirmed Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Is-Admin-Project: True Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Project-Domain-Id: default Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Project-Domain-Name: Default Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Project-Id: c0ce80734b754922ab08055a8061587e Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Project-Name: admin Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Role: admin,member,reader Aug 05 07:07:49.819942 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Roles: admin,member,reader Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0ce80734b754922ab08055a8061587e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0ce80734b754922ab08055a8061587e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0ce80734b754922ab08055a8061587e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0ce80734b754922ab08055a8061587e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Tenant: admin Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Tenant-Id: c0ce80734b754922ab08055a8061587e Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Tenant-Name: admin Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User: admin Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User-Domain-Id: default Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User-Domain-Name: Default Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User-Id: 1acd68042e0349f6afed23e5889b5da6 Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User-Name: admin Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: method: > Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: exception: Flavor 84 could not be found. Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: action_args: {'id': '84'} Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:07:49.821304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:07:49.822320 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:49.823613 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-67133bc9-b119-45a0-85ab-6344a474dce6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:07:49.824955 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-67133bc9-b119-45a0-85ab-6344a474dce6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.426932 Aug 05 07:07:49.824955 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Fri Aug 5 07:07:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:49.831874 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-0a755fc9-3a37-4747-812e-f6a7c9663d29 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:49.847304 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-0a755fc9-3a37-4747-812e-f6a7c9663d29 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019070 Aug 05 07:07:49.847911 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Aug 5 07:07:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:07:49.859867 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-bcd3afc4-4707-48b8-a1f4-628e0d85f5f1 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:49.877338 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-bcd3afc4-4707-48b8-a1f4-628e0d85f5f1 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020961 Aug 05 07:07:49.877894 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Aug 5 07:07:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:07:49.888288 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-6c523e59-5aba-4f94-993c-0885c7a5670d admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:49.894441 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-6c523e59-5aba-4f94-993c-0885c7a5670d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-6c523e59-5aba-4f94-993c-0885c7a5670d admin admin] Request method failure captured: Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Accept: application/json Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Connection: keep-alive Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Content-Length: 0 Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Host: 10.222.0.27 Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABi7MHFqVI2u2WRA1zslbSWQi-D6jbAU0kM9SGjhuTkBIyFIB_1Z86f4DG5SBOvmbVkeqAEVW4NmljXtmOxpEATFmrJsE_6Yqjo-FFALeiqJ1BfDurGITL_0dqrw5xc4yJLyT2XsMoLsrL1J-DL61rYxrfLl2F-on2_cW21dZs3_FucatU Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Domain-Id: None Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Domain-Name: None Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Project-Id: c0ce80734b754922ab08055a8061587e Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Project-Name: admin Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Role: admin,member,reader Aug 05 07:07:49.896224 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Roles: admin,member,reader Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0ce80734b754922ab08055a8061587e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0ce80734b754922ab08055a8061587e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0ce80734b754922ab08055a8061587e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0ce80734b754922ab08055a8061587e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Tenant: admin Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Tenant-Id: c0ce80734b754922ab08055a8061587e Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User: admin Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User-Id: 1acd68042e0349f6afed23e5889b5da6 Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User-Name: admin Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: method: > Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: exception: Flavor 84 could not be found. Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: action_args: {'id': '84'} Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:07:49.897755 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:07:49.898723 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:49.900627 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-6c523e59-5aba-4f94-993c-0885c7a5670d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:07:49.901917 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-6c523e59-5aba-4f94-993c-0885c7a5670d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013444 Aug 05 07:07:49.903559 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Fri Aug 5 07:07:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:50.907047 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-bcd3afc4-4707-48b8-a1f4-628e0d85f5f1 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:50.908046 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-bcd3afc4-4707-48b8-a1f4-628e0d85f5f1 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 05 07:07:50.908433 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 5 07:07:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:51.470079 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-437c6dec-a709-4106-b0e0-e55392d646f6 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:51.477080 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-437c6dec-a709-4106-b0e0-e55392d646f6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-437c6dec-a709-4106-b0e0-e55392d646f6 admin admin] Request method failure captured: Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Accept: application/json Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Connection: keep-alive Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Content-Length: 0 Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Host: 10.222.0.27 Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABi7MHGYUyUQL6LxMd5J6kam4OKezeI7SsCcyFP1Qbwo1ca0yWdjmctopbpY2IryJQBhgyLG8idDLJPp2fAi0mbi1Sx4rKRfOIsf7mRns-K3uSUhIpFEZykZIHfH90eL1eiQEfnTgarW5iwqc3VEKAIKtQGr71CneNOd3hOafEkeHH82r8 Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Domain-Id: None Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Domain-Name: None Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Project-Id: c0ce80734b754922ab08055a8061587e Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Project-Name: admin Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Role: admin,member,reader Aug 05 07:07:51.478599 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Roles: admin,member,reader Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0ce80734b754922ab08055a8061587e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0ce80734b754922ab08055a8061587e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0ce80734b754922ab08055a8061587e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0ce80734b754922ab08055a8061587e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Tenant: admin Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Tenant-Id: c0ce80734b754922ab08055a8061587e Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User: admin Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User-Id: 1acd68042e0349f6afed23e5889b5da6 Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: X-User-Name: admin Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: method: > Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: exception: Flavor 451 could not be found. Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: action_args: {'id': '451'} Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:07:51.480162 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:07:51.481182 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Aug 05 07:07:51.482458 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-437c6dec-a709-4106-b0e0-e55392d646f6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:07:51.483646 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-437c6dec-a709-4106-b0e0-e55392d646f6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.433728 Aug 05 07:07:51.483646 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Aug 5 07:07:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:51.490348 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-f961a52e-fc95-4202-80d6-d4dcdda795f0 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:51.506467 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-f961a52e-fc95-4202-80d6-d4dcdda795f0 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019871 Aug 05 07:07:51.507039 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Aug 5 07:07:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:07:51.517072 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:51.547089 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033628 Aug 05 07:07:51.547654 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Aug 5 07:07:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:07:51.559642 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-b0e3ed1b-07da-4018-8496-61c620602b91 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:51.567236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.wsgi [None req-b0e3ed1b-07da-4018-8496-61c620602b91 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-b0e3ed1b-07da-4018-8496-61c620602b91 admin admin] Request method failure captured: Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Accept: application/json Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Accept-Encoding: gzip, deflate Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Connection: keep-alive Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Content-Length: 0 Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Host: 10.222.0.27 Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Openstack-Api-Version: compute 2.90 Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Openstack-System-Scope: None Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: User-Agent: python-novaclient Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Auth-Token: gAAAAABi7MHGYUyUQL6LxMd5J6kam4OKezeI7SsCcyFP1Qbwo1ca0yWdjmctopbpY2IryJQBhgyLG8idDLJPp2fAi0mbi1Sx4rKRfOIsf7mRns-K3uSUhIpFEZykZIHfH90eL1eiQEfnTgarW5iwqc3VEKAIKtQGr71CneNOd3hOafEkeHH82r8 Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Domain-Id: None Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Domain-Name: None Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Identity-Status: Confirmed Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Is-Admin-Project: True Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Project-Domain-Id: default Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Project-Domain-Name: Default Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Project-Id: c0ce80734b754922ab08055a8061587e Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Project-Name: admin Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Role: admin,member,reader Aug 05 07:07:51.568670 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Roles: admin,member,reader Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0ce80734b754922ab08055a8061587e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0ce80734b754922ab08055a8061587e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0ce80734b754922ab08055a8061587e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0ce80734b754922ab08055a8061587e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Tenant: admin Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Tenant-Id: c0ce80734b754922ab08055a8061587e Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-Tenant-Name: admin Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User: admin Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User-Domain-Id: default Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User-Domain-Name: Default Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User-Id: 1acd68042e0349f6afed23e5889b5da6 Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: X-User-Name: admin Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: method: > Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: exception: Flavor 451 could not be found. Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: action_args: {'id': '451'} Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:07:51.570236 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:07:51.571289 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 07:07:51.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Aug 05 07:07:51.573740 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-b0e3ed1b-07da-4018-8496-61c620602b91 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:07:51.573740 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-b0e3ed1b-07da-4018-8496-61c620602b91 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.018380 Aug 05 07:07:51.574028 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Aug 5 07:07:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:52.557002 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:52.558054 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 05 07:07:52.558447 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 5 07:07:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:53.114458 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-8f75e50d-b48b-4cad-a09a-daf70aeaa43f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:53.136121 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-8f75e50d-b48b-4cad-a09a-daf70aeaa43f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.440384 Aug 05 07:07:53.136677 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Fri Aug 5 07:07:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:07:54.110738 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:54.111760 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 05 07:07:54.112195 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 5 07:07:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:54.664276 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-a9df6286-f686-45d5-bfd3-7b469f556afd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:54.686151 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-a9df6286-f686-45d5-bfd3-7b469f556afd admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.436734 Aug 05 07:07:54.686723 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Fri Aug 5 07:07:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:07:55.653566 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:55.654561 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 05 07:07:55.654951 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 5 07:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:56.201304 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-f784cad2-a9ba-4eba-b48c-fb590016f6df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:56.224596 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-f784cad2-a9ba-4eba-b48c-fb590016f6df admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.435114 Aug 05 07:07:56.225198 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Fri Aug 5 07:07:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:07:57.204361 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:57.205429 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 05 07:07:57.205832 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 5 07:07:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:57.770442 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-1b20bf9f-b233-44de-9ab2-c26562d6fea8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:07:57.791635 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-1b20bf9f-b233-44de-9ab2-c26562d6fea8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.443695 Aug 05 07:07:57.792179 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Fri Aug 5 07:07:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:07:58.798651 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:58.799679 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 05 07:07:58.800082 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 5 07:07:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:07:59.353633 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-6c640e80-374e-44a2-893b-822f1a05acde admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:07:59.374325 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-6c640e80-374e-44a2-893b-822f1a05acde admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.435637 Aug 05 07:07:59.374857 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Fri Aug 5 07:07:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:08:52.409318 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:08:52.410346 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-15116563-ec3c-4b68-abeb-809845aafc7e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Aug 05 07:08:52.410769 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Fri Aug 5 07:08:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:08:52.421875 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:52.839977 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-78ab600d-802c-422e-ad7d-ba9f55f1462b admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:08:52.861022 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-78ab600d-802c-422e-ad7d-ba9f55f1462b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.443588 Aug 05 07:08:52.861698 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Fri Aug 5 07:08:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:08:52.883811 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=14 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:52.888147 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-ebd6e09e-f070-4978-9bab-2b12eb35df3f admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:08:52.897179 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-ebd6e09e-f070-4978-9bab-2b12eb35df3f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014532 Aug 05 07:08:52.897766 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Fri Aug 5 07:08:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:08:52.911085 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-b71981c8-2dad-4882-b263-e47e660149a8 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:08:52.919863 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-b71981c8-2dad-4882-b263-e47e660149a8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012566 Aug 05 07:08:52.920438 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Fri Aug 5 07:08:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:08:52.933242 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-aa2ddbd8-a0a0-48d8-a88d-e5affcdaa9d9 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:08:52.941961 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-aa2ddbd8-a0a0-48d8-a88d-e5affcdaa9d9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012610 Aug 05 07:08:52.942552 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Fri Aug 5 07:08:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:08:52.954923 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-53f38650-3de1-4b81-a7a6-91910b899968 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:08:52.963424 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-53f38650-3de1-4b81-a7a6-91910b899968 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012244 Aug 05 07:08:52.963976 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Fri Aug 5 07:08:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:11:53.132115 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-aa2ddbd8-a0a0-48d8-a88d-e5affcdaa9d9 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:11:53.133194 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-aa2ddbd8-a0a0-48d8-a88d-e5affcdaa9d9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 05 07:11:53.133615 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 5 07:11:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:11:53.282411 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=6 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:11:53.480733 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-ce8fe182-c0c1-403b-9bac-cb7f9eac49bf admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:11:53.483318 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:11:53.483318 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: warnings.warn(msg) Aug 05 07:11:53.484548 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-ce8fe182-c0c1-403b-9bac-cb7f9eac49bf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:11:53.485059 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-ce8fe182-c0c1-403b-9bac-cb7f9eac49bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:11:53.485501 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-ce8fe182-c0c1-403b-9bac-cb7f9eac49bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:11:53.486198 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-ce8fe182-c0c1-403b-9bac-cb7f9eac49bf admin admin] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:11:53.486675 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-ce8fe182-c0c1-403b-9bac-cb7f9eac49bf admin admin] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:11:53.487095 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-ce8fe182-c0c1-403b-9bac-cb7f9eac49bf admin admin] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:11:53.536567 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-ce8fe182-c0c1-403b-9bac-cb7f9eac49bf admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.263734 Aug 05 07:11:53.537118 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Aug 5 07:11:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:11:54.383845 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-aa2ddbd8-a0a0-48d8-a88d-e5affcdaa9d9 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:11:54.385173 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-aa2ddbd8-a0a0-48d8-a88d-e5affcdaa9d9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001790 Aug 05 07:11:54.385784 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 5 07:11:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:11:54.581666 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-3280b7f7-92e6-44ce-b572-3ee3941c9a95 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:11:54.584209 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:11:54.584209 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: warnings.warn(msg) Aug 05 07:11:54.585393 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-3280b7f7-92e6-44ce-b572-3ee3941c9a95 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:11:54.585895 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-3280b7f7-92e6-44ce-b572-3ee3941c9a95 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:11:54.586349 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-3280b7f7-92e6-44ce-b572-3ee3941c9a95 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:11:54.587060 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-3280b7f7-92e6-44ce-b572-3ee3941c9a95 admin admin] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:11:54.587535 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-3280b7f7-92e6-44ce-b572-3ee3941c9a95 admin admin] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:11:54.587941 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-3280b7f7-92e6-44ce-b572-3ee3941c9a95 admin admin] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:11:54.608234 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-3280b7f7-92e6-44ce-b572-3ee3941c9a95 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083479 Aug 05 07:11:54.608823 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Aug 5 07:11:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:12:06.059674 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-aa2ddbd8-a0a0-48d8-a88d-e5affcdaa9d9 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:12:06.060855 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-aa2ddbd8-a0a0-48d8-a88d-e5affcdaa9d9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001733 Aug 05 07:12:06.061345 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 5 07:12:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:12:06.220495 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell0:SELECT=4 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:12:06.221269 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell1:SELECT=4 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:12:06.221797 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=8 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:12:06.287414 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-0e849f8a-293c-42d0-b9e2-a67246b3ab33 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:12:06.290069 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:12:06.290069 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: warnings.warn(msg) Aug 05 07:12:06.291270 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-0e849f8a-293c-42d0-b9e2-a67246b3ab33 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:12:06.291757 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-0e849f8a-293c-42d0-b9e2-a67246b3ab33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:12:06.292189 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-0e849f8a-293c-42d0-b9e2-a67246b3ab33 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:12:06.293217 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-0e849f8a-293c-42d0-b9e2-a67246b3ab33 admin admin] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:12:06.293394 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-0e849f8a-293c-42d0-b9e2-a67246b3ab33 admin admin] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:12:06.293788 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-0e849f8a-293c-42d0-b9e2-a67246b3ab33 admin admin] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:12:06.320431 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-0e849f8a-293c-42d0-b9e2-a67246b3ab33 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.105496 Aug 05 07:12:06.321070 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Aug 5 07:12:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:12:07.194207 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-aa2ddbd8-a0a0-48d8-a88d-e5affcdaa9d9 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:12:07.195310 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-aa2ddbd8-a0a0-48d8-a88d-e5affcdaa9d9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Aug 05 07:12:07.195861 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Aug 5 07:12:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:12:07.427848 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-643ce685-f6f7-4227-8136-058f10757d68 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:12:07.430754 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:12:07.430754 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: warnings.warn(msg) Aug 05 07:12:07.431939 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-643ce685-f6f7-4227-8136-058f10757d68 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:12:07.432410 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-643ce685-f6f7-4227-8136-058f10757d68 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:12:07.432832 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-643ce685-f6f7-4227-8136-058f10757d68 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:12:07.433720 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-643ce685-f6f7-4227-8136-058f10757d68 admin admin] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:12:07.434164 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-643ce685-f6f7-4227-8136-058f10757d68 admin admin] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:12:07.434569 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-643ce685-f6f7-4227-8136-058f10757d68 admin admin] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:12:07.457487 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-643ce685-f6f7-4227-8136-058f10757d68 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095158 Aug 05 07:12:07.458075 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Aug 5 07:12:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:13:05.557111 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: Fri Aug 5 07:13:05 2022 - graceful shutdown triggered... Aug 05 07:13:05.557151 dv-cinder-852007-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 05 07:13:05.558605 dv-cinder-852007-1-iscsi devstack@n-api.service[103406]: Gracefully killing worker 1 (pid: 103406)... Aug 05 07:13:05.559170 dv-cinder-852007-1-iscsi devstack@n-api.service[103407]: Gracefully killing worker 2 (pid: 103407)... Aug 05 07:13:06.559915 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: worker 1 buried after 1 seconds Aug 05 07:13:06.559915 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: worker 2 buried after 1 seconds Aug 05 07:13:06.559915 dv-cinder-852007-1-iscsi devstack@n-api.service[103405]: goodbye to uWSGI. Aug 05 07:13:06.561555 dv-cinder-852007-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 05 07:13:06.562152 dv-cinder-852007-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 05 07:13:06.565059 dv-cinder-852007-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 07:13:06.574725 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 07:13:06.576743 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 07:13:06 2022] *** Aug 05 07:13:06.576743 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 07:13:06.576743 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 07:13:06.576743 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: nodename: dv-cinder-852007-1-iscsi Aug 05 07:13:06.576743 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: machine: x86_64 Aug 05 07:13:06.576743 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: clock source: unix Aug 05 07:13:06.576743 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: pcre jit disabled Aug 05 07:13:06.576743 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: detected number of CPU cores: 4 Aug 05 07:13:06.576743 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: current working directory: / Aug 05 07:13:06.576743 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: detected binary path: /usr/bin/uwsgi-core Aug 05 07:13:06.577555 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: your processes number limit is 47680 Aug 05 07:13:06.577555 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: your memory page size is 4096 bytes Aug 05 07:13:06.577555 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: detected max file descriptor number: 2048 Aug 05 07:13:06.577555 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: lock engine: pthread robust mutexes Aug 05 07:13:06.577555 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: thunder lock: enabled Aug 05 07:13:06.577555 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 07:13:06.577555 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 07:13:06.615982 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: Python main interpreter initialized at 0x5596941449c0 Aug 05 07:13:06.615982 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: python threads support enabled Aug 05 07:13:06.615982 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: your server socket listen backlog is limited to 100 connections Aug 05 07:13:06.615982 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: your mercy for graceful operations on workers is 90 seconds Aug 05 07:13:06.616395 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 07:13:06.616395 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: *** Operational MODE: preforking *** Aug 05 07:13:06.616690 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: *** uWSGI is running in multiple interpreter mode *** Aug 05 07:13:06.616690 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: spawned uWSGI master process (pid: 117883) Aug 05 07:13:06.616987 dv-cinder-852007-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 07:13:06.617466 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: spawned uWSGI worker 1 (pid: 117893, cores: 1) Aug 05 07:13:06.617901 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: spawned uWSGI worker 2 (pid: 117894, cores: 1) Aug 05 07:13:06.618139 dv-cinder-852007-1-iscsi devstack@n-api.service[117883]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 07:13:07.286077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 07:13:07.288433 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 07:13:08.428618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 07:13:08.428618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: from cryptography.utils import int_from_bytes Aug 05 07:13:08.429427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 07:13:08.429427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: from cryptography.utils import int_from_bytes Aug 05 07:13:08.446919 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 07:13:08.446919 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: from cryptography.utils import int_from_bytes Aug 05 07:13:08.447615 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 07:13:08.447615 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: from cryptography.utils import int_from_bytes Aug 05 07:13:10.723610 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 07:13:10.724322 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 07:13:10.724475 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 07:13:10.724737 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 07:13:10.725023 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 07:13:10.725407 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.725763 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.726079 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.726079 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.726079 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.726079 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.726079 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.726079 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.726079 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.726079 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.731068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.731068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852007-1-iscsi {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.731068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.731068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.731068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.731068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.731068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.731068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.731634 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.731634 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.731790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.733478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.733478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.733478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.733478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.733478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.733478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.733956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.734209 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.734590 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.734831 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852007-1-iscsi {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.735134 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.735630 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.736200 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.736625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.736841 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.737186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.737544 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.737886 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.738189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.738503 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.738819 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.739138 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.739442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.739737 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.740262 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.740525 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.740889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.741183 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.741497 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.741754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.742068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.742364 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.742679 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.742958 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.743238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.743464 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.743768 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.744080 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.744426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.744705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.744997 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.745305 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.745612 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.745915 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.746217 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.746550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.746861 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.747146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.747458 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.747779 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.748090 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.748483 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.748731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.749055 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.749459 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.749771 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.750073 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.750385 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.750696 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.750993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.751298 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.751594 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.751905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.752233 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.752530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.752777 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.753083 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.753385 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.753697 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.753999 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.754302 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.754603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.754897 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.755218 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.755500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.755799 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.756135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.756391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.756692 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.757017 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.757318 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.757620 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.757935 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.758244 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.758582 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.758839 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.759138 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.759438 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.759752 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.760051 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.760350 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.760665 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.760991 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.761294 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.761605 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.761906 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.762206 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.762518 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.762811 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.763113 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.763424 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.763750 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.764026 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.764322 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.764638 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.764959 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.765347 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.765568 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.765866 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.766281 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.766469 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.766847 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.767086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.767387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.767687 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.768007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.768328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.768714 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.769015 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.769328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.769656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.769982 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.770840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.770840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.771163 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.771329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.771485 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.771784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.772091 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.772401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.772708 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.773054 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.773363 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.773674 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.773985 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.774290 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.774603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.774999 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.775240 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.775553 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.775889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.776402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.776578 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.776980 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.777798 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.777798 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.777798 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.778357 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.778357 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.778685 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.778947 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.779259 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.779933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.780243 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.780606 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.780992 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.781246 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.781582 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.781892 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.782202 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.782509 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.782819 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.783024 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 07:13:10.783532 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.783532 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.783822 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 07:13:10.783964 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.784115 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.784257 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.784406 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 07:13:10.784562 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.784845 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.785063 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 07:13:10.785227 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.785478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.785726 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 07:13:10.785899 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.786084 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.786544 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.786740 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.786740 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.787149 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.787309 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.787309 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.787601 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.787755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.788049 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.788226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.788472 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.788472 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.788765 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.788941 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.789187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.789424 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.789582 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.789761 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.789918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.790062 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.790214 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.790365 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.790575 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.790881 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.791110 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.791335 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.791593 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.791900 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.792060 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.792213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.792498 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852007-1-iscsi {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.792657 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.792814 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.793085 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.793260 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.793447 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.793633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.793782 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.794095 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.794252 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.794395 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.794627 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.794821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.795010 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.795173 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.795319 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.795615 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.795869 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.796061 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.796253 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.796407 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.796737 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.796959 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.797144 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.797460 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.797460 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.797802 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.797966 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.797966 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.798384 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.798646 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.798646 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.798954 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.799104 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.799351 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.799508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.799671 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.799822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.799975 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.800118 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.800307 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.800465 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.800629 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.800941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.801106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.801258 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.801496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.801646 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.801876 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.802076 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.802235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.802480 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.802636 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.802794 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.803077 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.803390 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852007-1-iscsi {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.803559 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.803714 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.803870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.804020 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.804267 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.804416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.804568 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.804870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.805049 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.805193 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.805505 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.805807 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.806060 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.806207 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.806386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.806536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.806867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.807035 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.807179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.807321 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.807576 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.807726 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.807927 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.808098 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.808292 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.808539 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.808777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.809017 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.809202 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.809377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.809614 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.809800 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.809962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.810106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.810362 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.810547 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.810909 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.811078 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.811241 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.811396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.811764 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.811945 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.811945 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.812325 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.812484 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.812627 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.812777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.812953 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.813179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.813336 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.813526 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.813783 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.813972 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.814128 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.814346 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.814512 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.814656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.814796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.814946 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.815215 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.815366 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.815519 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.815819 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.815987 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.816230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.816410 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.816559 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.816712 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.817066 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.817241 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.817389 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.817559 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.817811 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.817961 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.818113 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.818279 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.818467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.818756 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.819007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.819169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.819321 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.819467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.819639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.819879 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.820042 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.820185 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.820336 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.820520 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.820713 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.820862 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.821142 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.821441 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.821603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.821779 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.822082 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.822317 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.822473 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.822670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.822872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.823027 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.823249 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.823408 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.823586 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.823807 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.824072 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.824231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.824382 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.824542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.824791 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.824969 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.825121 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.825370 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.825539 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.825694 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.825965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.826113 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.826352 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.826572 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.826738 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.826883 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.827243 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.827442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.827590 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.827857 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.828026 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.828225 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.828372 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.828524 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.829049 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.829229 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.829391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.829544 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.829694 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.830101 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.830255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.830398 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.830551 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.830701 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.830858 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.831033 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.831226 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.831429 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.831586 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.831740 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.832020 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.832183 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.832326 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.832601 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.832757 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.832926 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.833228 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.833392 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.833535 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.833812 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.833968 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.834238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.834403 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.834558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.834710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.834852 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.835603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.835603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.835919 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.836077 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.836221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.836382 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.836382 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.836747 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.836931 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.836931 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.837244 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.839288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.839288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.839609 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.839770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.839770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.840082 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.840334 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.840334 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.840625 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.840778 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.840941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.841090 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.841090 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.841383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.841540 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.841540 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.841819 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.841969 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.841969 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.842260 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.842413 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.842413 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.842691 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.842832 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.842832 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.843293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.843454 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.843607 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.843758 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.843758 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.844035 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.844357 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.844520 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.844664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.844664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.845024 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.845184 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.845184 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.845474 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.845618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.845618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.845897 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.846039 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.846039 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.846385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.846528 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.846528 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.846915 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.847067 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.847067 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.847402 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.847727 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.847727 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.848022 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.848164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.848306 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.848459 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.848459 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.848750 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.848917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.848917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.849483 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.849633 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.849633 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.849934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.850085 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.850085 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.850376 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.850618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.850618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.850918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.851069 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.851069 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.851364 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.851515 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.851667 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.851820 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.851820 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.852108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.852250 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.852250 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.852538 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.852699 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.852699 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.853051 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.853266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.853438 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.853587 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.853737 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.853886 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.854094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.854253 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.854435 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.854706 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.854868 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.855032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.855188 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.855345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.855584 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.855736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.855885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.856130 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.856296 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.856469 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.856710 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.856987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.857165 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.857336 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.857495 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.857830 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.858011 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.858164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.858312 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.858467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.858664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.858906 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.859074 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.859365 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.859719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.859884 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.859884 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.860216 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.860403 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.860403 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.860815 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.860997 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.860997 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.861299 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.861450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.861607 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.861755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 07:13:10.861914 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.862185 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.862385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.862536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.862752 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.862908 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.863064 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.863341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.863503 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.863670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.863885 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.864042 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.864215 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.864460 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.864641 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.865008 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.866137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.866313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.866313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.866615 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.866774 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.866774 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.867162 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.867317 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.867317 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.867626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.867784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.867784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.868278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.868435 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.868603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.868772 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.868772 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.869098 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.869257 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.869257 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.869890 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.870057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.870208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.870368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.870368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.870685 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.870954 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.870954 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.870954 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.871395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.871545 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.871545 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.871854 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.872012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.872012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.872303 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.872459 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.872631 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.872783 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.872783 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.873106 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.873256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.873256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.873555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.873712 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.873863 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.874018 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.874188 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.874443 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.874607 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.874757 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.875052 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.875228 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.875389 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.875549 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.875700 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.875880 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.876129 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.876294 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.876559 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.876728 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.876879 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.877158 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.877404 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.877560 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.877722 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.877882 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.878235 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.878416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.878570 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.878719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.878882 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.879033 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.880036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.880036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.880493 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.880645 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.880645 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.880984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.881254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.881254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.881565 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.881722 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.881722 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.882032 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.882189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.882341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.882501 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.882501 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.882809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.882960 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.883117 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.883275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.883425 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.883620 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.883786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.883947 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.884188 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.884355 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.884515 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.884744 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.885145 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.885145 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.885583 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.885733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.885892 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.886097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.886248 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.886398 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.886557 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.886716 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.886874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.887111 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.887288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.887548 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.887712 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.887873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.888034 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.888845 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.889063 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.889230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.889230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.889516 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.889677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.889836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.890232 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.890232 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.890685 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.890845 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.890845 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.891142 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.891442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.891442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.891745 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.891895 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.892056 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.892215 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.892215 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.892565 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.892729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.892729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.893058 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.893228 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.893387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.893538 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.893538 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.893838 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.893997 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.893997 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.894344 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.894500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.894660 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.894892 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.894892 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.895181 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.895330 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.895643 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.895807 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.895978 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.896139 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.896307 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.896307 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.896600 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.896765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.896947 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.897113 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.897272 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.897488 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.897757 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.897930 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.898092 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.898242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.898399 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.898663 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.899007 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.899179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.899340 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.899502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.899661 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.899811 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.899967 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.900152 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.900479 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.900756 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.900756 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.901154 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.901324 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.901324 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.901722 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.901892 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.902043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.902201 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.902368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.902526 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.902676 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.902826 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.902974 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.903131 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.903398 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.903566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.903727 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.904000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.904178 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.904963 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.905144 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.905298 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.905562 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.905848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.906016 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.906182 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.906343 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.906556 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.906719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.906878 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.907157 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.907338 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.907499 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.907796 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.907970 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.908120 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.908346 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.908524 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.908684 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.909080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.909252 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.909403 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.909572 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.909736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.909895 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.910060 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.910211 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.910563 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.910759 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.911030 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.911199 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.911357 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.911516 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.912399 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.912577 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.912577 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.912889 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.913132 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.913132 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.913431 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.913590 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.913590 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.913876 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.914025 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.914175 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.914342 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.914342 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.914650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.914801 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.914801 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.915096 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.915255 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.915255 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.915543 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.915691 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.915870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.916144 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.916144 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.916435 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.916583 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.916849 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.917046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.917310 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.917467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.917628 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.917922 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.918089 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.918240 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.918513 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.918672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.918830 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.919027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.919358 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.919525 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.919690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.919853 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.920005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.920162 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.920321 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.920715 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.920882 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.921249 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.921249 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.921636 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.921817 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.921817 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.922238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.922396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.922555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.922714 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.922960 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.923134 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.923285 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.923517 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.923690 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.923882 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.924047 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.924215 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.925106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.925314 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.925478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.925630 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.925795 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.925795 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.926080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.926419 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.926419 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.926731 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.926892 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.927043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.927192 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.927192 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.927536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.927689 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.927689 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.928017 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.928274 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.928274 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.928564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.928713 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.928873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.929063 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.929063 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.929574 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.929752 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.929752 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.930051 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.930208 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.930208 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.930495 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.930655 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.931062 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.931238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.931238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.931686 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.931836 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.931985 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.932282 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.932282 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.932586 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.932735 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.932735 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.933066 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.933231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.933231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.933534 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.933685 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.933843 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.934008 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.934008 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.934312 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.934476 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.934626 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.934783 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.934942 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.935155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.935312 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.935461 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.935719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.935905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.936115 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.936343 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.936885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.937262 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.937514 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.937514 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.937976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.938254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.938566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.938725 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.938725 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.939014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.939199 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.939199 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.939716 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.939922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.939922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.940468 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.940715 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.940715 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.941496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.941830 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.941830 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.942155 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.942419 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.942419 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.942713 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.942881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.942881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.943180 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.943340 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.943340 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.943705 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.943865 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.943865 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.944165 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.944328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.944328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.944763 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.944942 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.945125 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.945288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.945288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.945589 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.945755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.945755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.946043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.946202 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.946202 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.946497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.946662 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.946662 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.947098 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.947269 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.947269 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.947559 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.947748 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.947748 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.948089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.948250 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.948250 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.948567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.948815 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.949056 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.949215 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.949215 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.949525 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.949717 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.949717 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.950207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.950360 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.950360 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.950654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.950819 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.950819 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.951123 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.951447 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.951447 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.951769 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.952043 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.952043 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.952336 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.952619 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.952619 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.952941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.953099 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.953261 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.953411 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.953561 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.953753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.953934 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.954086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.954343 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.954509 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.954668 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.954901 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.955070 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.955222 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.955482 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.955687 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.955840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.955998 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.956168 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.956339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.956550 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.956719 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.957047 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.958515 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.958693 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.958693 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.959096 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.959261 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.959261 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.959625 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.959782 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.959782 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.960270 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.960422 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.960422 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.960722 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.960875 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.960875 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.961185 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.961352 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.961352 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.961836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.961988 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.961988 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.962433 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.962603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.962603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.962995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.963146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.963146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.963439 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.963589 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.963589 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.964497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.964649 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.964809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.964983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.964983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.965310 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.965470 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.965470 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.965765 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.965915 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.965915 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.966212 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.966372 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.966372 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.966667 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.966825 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.966825 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.967341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.967567 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.967567 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.967871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.968207 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.968207 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.968519 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.968669 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.968669 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.969113 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.969285 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.969458 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.969633 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.969633 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.969920 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.970270 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.970453 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.970913 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.971387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.971803 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.971973 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.972369 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.972716 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.973015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.973211 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.973514 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.973693 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.974109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.974281 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.974613 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.974778 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.974937 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.975166 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.975335 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.975578 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.975742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.975894 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.976187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.976344 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.976609 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.976767 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.976971 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 07:13:10.977247 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.977830 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.978218 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.978705 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.979226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.979670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.980150 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.980622 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.981167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.981683 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.982177 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.982724 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.983151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.983643 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.984163 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.984653 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.985180 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.985802 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.986407 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.986856 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.987341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.987823 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.988300 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.988852 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.989361 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.989885 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.990396 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.990934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.991411 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.992585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.992585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.993367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.993367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.993855 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.994268 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.994748 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.995227 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.995713 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.996193 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.996717 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.997222 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.997699 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.998252 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.998648 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.999274 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:10.999771 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.000249 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.003872 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.003872 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.003872 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.003872 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.003872 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.003872 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.005861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.005861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.005861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.006315 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.006889 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.008237 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.008237 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.008608 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.008983 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.009551 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.010125 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.010702 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.012140 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.012998 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.013406 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.023976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.025742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.025742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.025742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.025742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.025742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.025742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.025742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.025742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.026931 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.026931 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.026931 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.026931 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.026931 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.026931 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.026931 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.026931 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.028095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.028095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.028095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.028095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.028095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.028095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.028095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.028095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.029285 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.029285 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.029285 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.029285 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.030248 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.030248 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.030594 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.030759 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.030979 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.031301 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.031616 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.031935 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.032251 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.032565 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.032952 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.033257 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.033569 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.033886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.034201 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.034519 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.034832 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.035314 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.035641 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.035964 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.036279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.036599 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.036949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.037284 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.037612 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.037925 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.038382 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.038704 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.039023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.039341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.039654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.039964 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.040285 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.040626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.040962 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.041296 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.041595 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.041938 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.042244 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.042564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.043015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.043336 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.043649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.044076 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.044393 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.044933 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.045057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.045388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.046217 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.046217 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.046402 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.046703 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.047037 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.047366 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.047743 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.048025 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.048368 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.048646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.049005 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.049332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.049660 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.050106 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.050602 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.051239 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.051716 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.052268 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.052760 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.053310 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.053823 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.054489 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.054836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.055353 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.055678 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.056011 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.056338 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.056664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.057067 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.057385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.057719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.058037 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.058375 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.058804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.059315 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.059789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.060117 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.060461 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.061043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.061247 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.061574 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.061938 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.062304 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.062625 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.062957 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.063423 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.063937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.064427 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.064961 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.065339 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.065672 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.066051 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.066644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.066751 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.067406 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.067406 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.067672 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.068189 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.068630 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.069136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.069459 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.069780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.070282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.070626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.070946 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.071285 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.071633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.071985 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.072366 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.072627 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.073144 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.073484 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.073831 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.074152 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.074487 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.074811 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.075135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.075468 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.075793 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.076116 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.076439 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.076762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.077105 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.077487 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.077816 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.078140 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.078734 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.079069 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.079392 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.079804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.080064 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.080340 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.080658 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.081004 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.081322 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.081639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.081955 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.082298 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.082629 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.082960 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.083310 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.083641 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.083964 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.084279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.084598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.085036 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.085318 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.085640 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.085958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.086277 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.086595 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.086912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.087229 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.087550 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.087868 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.088182 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.088498 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.088867 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.089983 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.090372 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.090686 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.091135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.091346 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.091668 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.091993 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.092579 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.092949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.093432 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.093768 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.094109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.094420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.094962 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.095299 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.095617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.095937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.096238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.096552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.096859 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.097212 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.097526 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.097834 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.098157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.098469 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.099057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.099421 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.099745 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.100076 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.100450 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.100729 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.101084 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.101418 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.101731 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.102044 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.102361 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.102675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.102983 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.103292 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.103607 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.103919 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.104227 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.104555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.104851 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.105210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.105530 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.105841 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.106149 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.106465 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.106773 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.107080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.107388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.107746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.108012 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.108317 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.108669 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.109063 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.109401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.109686 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.110000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.110308 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.110662 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.110953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.111318 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.111647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.111960 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.112288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.112604 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.112938 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.113302 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.113624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.114224 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.114572 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.114919 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.115236 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.115579 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.115890 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.116199 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.116506 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.116835 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.117179 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.117494 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.117810 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.118125 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.118438 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.118751 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.119067 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.119381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.119710 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.120008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.120401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.120651 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.120963 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.121279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.121601 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.121956 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.122283 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.122604 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.122922 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.123246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.123548 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.123852 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.124162 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.124526 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.124844 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.125205 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.125530 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.125840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.126280 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.126627 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.126950 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.127276 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.127591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.127917 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.128244 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.128568 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.128913 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.129228 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.129561 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.129911 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.130246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.130574 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.130885 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.131193 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.131500 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.131816 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.132138 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.132452 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.132762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.133101 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.133415 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.133724 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.134033 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.134339 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.134648 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.134975 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.135293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.135586 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.135891 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.136196 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.136502 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.136818 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.137151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.137395 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO dbcounter [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Registered counter for database nova_api Aug 05 07:13:11.137495 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.137757 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.138064 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.138372 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.138677 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.139020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.139359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.139678 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.140079 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.140401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.140725 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.141063 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.141392 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.141720 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.142051 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.142360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.142700 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.143014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.143329 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.143647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.143962 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.144275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.144587 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.144940 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.145281 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.145591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.145919 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.146240 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.146572 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.146888 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.147203 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.147535 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.147853 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.148182 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.148482 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.148797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.149146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.149548 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.149867 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.150185 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.150509 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.150831 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.151162 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.151490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.152270 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.152775 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.153547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.154238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.154238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.155840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.155840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.155840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.155840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.156162 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 07:13:11.156391 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 07:13:11.159412 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_db.sqlalchemy.engines [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:13:11.167031 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writer thread running {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:13:11.226830 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.context [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4447999f-53a9-44bb-be53-fbe9a3e421dd(cell1) {{(pid=117893) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 07:13:11.231192 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:13:11.231642 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:13:11.233325 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:13:11.234178 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:13:11.234632 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:13:11.236760 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:13:11.238927 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO dbcounter [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Registered counter for database nova_cell0 Aug 05 07:13:11.243362 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO dbcounter [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Registered counter for database nova_cell1 Aug 05 07:13:11.251220 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_db.sqlalchemy.engines [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:13:11.253425 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_db.sqlalchemy.engines [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:13:11.260508 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writer thread running {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:13:11.262291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writer thread running {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:13:11.311049 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO dbcounter [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Registered counter for database nova_api Aug 05 07:13:11.332706 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_db.sqlalchemy.engines [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:13:11.340926 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writer thread running {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:13:11.407670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.context [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4447999f-53a9-44bb-be53-fbe9a3e421dd(cell1) {{(pid=117894) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 07:13:11.411833 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:13:11.412304 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:13:11.413002 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO dbcounter [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Registered counter for database nova_cell0 Aug 05 07:13:11.413925 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:13:11.414660 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:13:11.415204 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:13:11.417307 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:13:11.419449 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO dbcounter [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Registered counter for database nova_cell0 Aug 05 07:13:11.420015 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_db.sqlalchemy.engines [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:13:11.424014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO dbcounter [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Registered counter for database nova_cell1 Aug 05 07:13:11.425184 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writer thread running {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:13:11.431485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_db.sqlalchemy.engines [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:13:11.433457 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_db.sqlalchemy.engines [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:13:11.439681 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writer thread running {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:13:11.441863 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writer thread running {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:13:11.589413 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO dbcounter [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Registered counter for database nova_cell0 Aug 05 07:13:11.598587 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_db.sqlalchemy.engines [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 07:13:11.604475 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writer thread running {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 07:13:11.755520 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: WARNING keystonemiddleware.auth_token [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 07:13:11.762999 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: WARNING keystonemiddleware.auth_token [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 07:13:11.930673 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: WARNING keystonemiddleware.auth_token [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 07:13:11.938356 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: WARNING keystonemiddleware.auth_token [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 07:13:12.111927 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: WARNING keystonemiddleware.auth_token [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 07:13:12.118544 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: WARNING keystonemiddleware.auth_token [None req-80360b04-56e9-4a25-a2cc-130cbb36e7a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 07:13:12.125786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596941449c0 pid: 117893 (default app) Aug 05 07:13:12.285072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: WARNING keystonemiddleware.auth_token [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 07:13:12.291201 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: WARNING keystonemiddleware.auth_token [None req-0bd4fb4e-6689-4db2-b2f3-e721aa985edf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 07:13:12.297743 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596941449c0 pid: 117894 (default app) Aug 05 07:13:47.594025 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:47.595001 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:47.596066 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:47.596873 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:47.961383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:47.963259 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:47.965032 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:47.967654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:48.885107 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-273f1a65-28a0-4ad8-a93b-212edadec37c tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] Action: 'create', calling method: .version_select at 0x7f4971ed5dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1755222500", "metadata": {"Type": "work"}}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:13:49.100291 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c3df1092-c245-4068-a59d-d21fd25adef1 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Action: 'create', calling method: .version_select at 0x7f4971ed7dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-233975873", "metadata": {"Type": "work"}}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c3df1092-c245-4068-a59d-d21fd25adef1 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Request method failure captured: Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 121 Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MMrDt1FzNA_chTnw4HAOlPcUUOsIReYt-3LCZUcwr03Gq9T32bxfwQZPPsY03L906-aqgui_x8YaTE7LBH0SgCRWTyxQO19WXOu-3YyBtSNN8zzmGrSbnLw7hdxudtz_ZhX6JJR_9Ew7-8EsnPyEWVcC7gA9VWHKRaUB1mX7-F4sKQ Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: efa588d5331d4d0b9ade4c0af72eac8d Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:13:49.107583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efa588d5331d4d0b9ade4c0af72eac8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: efa588d5331d4d0b9ade4c0af72eac8d Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-VolumesNegativeTest-1473649575-project Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: fd2a5862bd074a548ca0189107777cc9 Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-VolumesNegativeTest-1473649575-project Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-233975873", "metadata": {"Type": "work"}}} Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: Aug 05 07:13:49.109360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-233975873', 'metadata': {'Type': 'work'}}}} Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise error Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi '#$%' Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:13:49.110330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 07:13:49.111924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 07:13:49.113275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 07:13:49.113275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.113275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c3df1092-c245-4068-a59d-d21fd25adef1 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:13:49.113275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c3df1092-c245-4068-a59d-d21fd25adef1 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.162591 Aug 05 07:13:49.114613 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1156 bytes} [Fri Aug 5 07:13:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 05 07:13:49.127681 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-38d96baa-a8d7-4305-b11a-b310bc7ccb84 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Action: 'create', calling method: .version_select at 0x7f4971de58b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-814457639", "metadata": {"Type": "work"}}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-38d96baa-a8d7-4305-b11a-b310bc7ccb84 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Request method failure captured: Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 119 Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MMrDt1FzNA_chTnw4HAOlPcUUOsIReYt-3LCZUcwr03Gq9T32bxfwQZPPsY03L906-aqgui_x8YaTE7LBH0SgCRWTyxQO19WXOu-3YyBtSNN8zzmGrSbnLw7hdxudtz_ZhX6JJR_9Ew7-8EsnPyEWVcC7gA9VWHKRaUB1mX7-F4sKQ Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: efa588d5331d4d0b9ade4c0af72eac8d Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:13:49.132566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efa588d5331d4d0b9ade4c0af72eac8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: efa588d5331d4d0b9ade4c0af72eac8d Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-VolumesNegativeTest-1473649575-project Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: fd2a5862bd074a548ca0189107777cc9 Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-VolumesNegativeTest-1473649575-project Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-814457639", "metadata": {"Type": "work"}}} Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: Aug 05 07:13:49.134112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-814457639', 'metadata': {'Type': 'work'}}}} Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise error Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi '0' Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:13:49.135039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 07:13:49.136524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 07:13:49.138083 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 07:13:49.138083 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.138950 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-38d96baa-a8d7-4305-b11a-b310bc7ccb84 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:13:49.140143 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-38d96baa-a8d7-4305-b11a-b310bc7ccb84 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017179 Aug 05 07:13:49.141306 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 2/2] 10.222.0.27 () {60 vars in 1156 bytes} [Fri Aug 5 07:13:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 05 07:13:49.153026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b25480b5-19f3-438f-bd49-1888247ddd8b tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Action: 'create', calling method: .version_select at 0x7f4971d93940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-878354938", "metadata": {"Type": "work"}}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b25480b5-19f3-438f-bd49-1888247ddd8b tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Request method failure captured: Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 118 Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MMrDt1FzNA_chTnw4HAOlPcUUOsIReYt-3LCZUcwr03Gq9T32bxfwQZPPsY03L906-aqgui_x8YaTE7LBH0SgCRWTyxQO19WXOu-3YyBtSNN8zzmGrSbnLw7hdxudtz_ZhX6JJR_9Ew7-8EsnPyEWVcC7gA9VWHKRaUB1mX7-F4sKQ Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: efa588d5331d4d0b9ade4c0af72eac8d Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:13:49.159695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efa588d5331d4d0b9ade4c0af72eac8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: efa588d5331d4d0b9ade4c0af72eac8d Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-VolumesNegativeTest-1473649575-project Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: fd2a5862bd074a548ca0189107777cc9 Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-VolumesNegativeTest-1473649575-project Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-878354938", "metadata": {"Type": "work"}}} Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: Aug 05 07:13:49.160958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-878354938', 'metadata': {'Type': 'work'}}}} Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise error Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi '' Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:13:49.161953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 07:13:49.163611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 07:13:49.164706 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 07:13:49.164706 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:49.164706 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b25480b5-19f3-438f-bd49-1888247ddd8b tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:13:49.164955 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b25480b5-19f3-438f-bd49-1888247ddd8b tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018182 Aug 05 07:13:49.166613 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 3/3] 10.222.0.27 () {60 vars in 1156 bytes} [Fri Aug 5 07:13:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 07:13:49.195036 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e3f81bb3-38b2-4e70-ad92-e88efb3144a7 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Calling method '.version_select at 0x7f4971d93940>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:13:50.162682 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-e3f81bb3-38b2-4e70-ad92-e88efb3144a7 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] HTTP exception thrown: Volume tempest-invalid-1419702198 could not be found. Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e3f81bb3-38b2-4e70-ad92-e88efb3144a7 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Request method failure captured: Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1419702198 HTTP/1.1 Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MMrDt1FzNA_chTnw4HAOlPcUUOsIReYt-3LCZUcwr03Gq9T32bxfwQZPPsY03L906-aqgui_x8YaTE7LBH0SgCRWTyxQO19WXOu-3YyBtSNN8zzmGrSbnLw7hdxudtz_ZhX6JJR_9Ew7-8EsnPyEWVcC7gA9VWHKRaUB1mX7-F4sKQ Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: efa588d5331d4d0b9ade4c0af72eac8d Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:13:50.183207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efa588d5331d4d0b9ade4c0af72eac8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: efa588d5331d4d0b9ade4c0af72eac8d Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-VolumesNegativeTest-1473649575-project Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: fd2a5862bd074a548ca0189107777cc9 Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-VolumesNegativeTest-1473649575-project Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Volume tempest-invalid-1419702198 could not be found. Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'tempest-invalid-1419702198'} Aug 05 07:13:50.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1419702198 could not be found. (HTTP 404) (Request-ID: req-bd1754ce-e4f5-4618-a43e-93d01381816a) Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:50.185817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 07:13:50.187293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1419702198 could not be found. Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:13:50.189231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1419702198 could not be found. Aug 05 07:13:50.191718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.191718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:50.191718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.191718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:50.191718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:50.191718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:50.191718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:13:50.191718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:13:50.191718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1419702198 could not be found. Aug 05 07:13:50.191718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.191718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e3f81bb3-38b2-4e70-ad92-e88efb3144a7 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Returning 404 to user: Volume tempest-invalid-1419702198 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:13:50.197890 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e3f81bb3-38b2-4e70-ad92-e88efb3144a7 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1419702198" status: 404 len: 99 microversion: 2.1 time: 1.016219 Aug 05 07:13:50.198178 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 4/4] 10.222.0.27 () {58 vars in 1218 bytes} [Fri Aug 5 07:13:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1419702198 => generated 99 bytes in 1018 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 05 07:13:50.223752 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-cf2711ce-95e3-4f99-9da2-d9f684aabe7f tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.019136 Aug 05 07:13:50.228947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 5/5] 10.222.0.27 () {58 vars in 1140 bytes} [Fri Aug 5 07:13:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 05 07:13:50.246927 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-cbe6acb5-573a-47e8-9f0d-f77ac24dc681 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014999 Aug 05 07:13:50.248781 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 6/6] 10.222.0.27 () {58 vars in 1137 bytes} [Fri Aug 5 07:13:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 07:13:50.265557 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d3c08e14-ff44-42f5-b77b-b3579857d852 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Calling method '.version_select at 0x7f4971cdcca0>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:13:50.428814 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-d3c08e14-ff44-42f5-b77b-b3579857d852 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] HTTP exception thrown: Volume 7af8ceec-fc69-4dca-92f0-5877dd37841a could not be found. Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d3c08e14-ff44-42f5-b77b-b3579857d852 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Request method failure captured: Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: DELETE /compute/v2.1/os-volumes/7af8ceec-fc69-4dca-92f0-5877dd37841a HTTP/1.1 Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MMrDt1FzNA_chTnw4HAOlPcUUOsIReYt-3LCZUcwr03Gq9T32bxfwQZPPsY03L906-aqgui_x8YaTE7LBH0SgCRWTyxQO19WXOu-3YyBtSNN8zzmGrSbnLw7hdxudtz_ZhX6JJR_9Ew7-8EsnPyEWVcC7gA9VWHKRaUB1mX7-F4sKQ Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: efa588d5331d4d0b9ade4c0af72eac8d Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:13:50.430930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efa588d5331d4d0b9ade4c0af72eac8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: efa588d5331d4d0b9ade4c0af72eac8d Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-VolumesNegativeTest-1473649575-project Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: fd2a5862bd074a548ca0189107777cc9 Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-VolumesNegativeTest-1473649575-project Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Volume 7af8ceec-fc69-4dca-92f0-5877dd37841a could not be found. Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': '7af8ceec-fc69-4dca-92f0-5877dd37841a'} Aug 05 07:13:50.432197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7af8ceec-fc69-4dca-92f0-5877dd37841a could not be found. (HTTP 404) (Request-ID: req-1a039b82-f18c-4a7e-8408-79750a9c4557) Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:50.433087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 07:13:50.434194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7af8ceec-fc69-4dca-92f0-5877dd37841a could not be found. Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 07:13:50.435263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7af8ceec-fc69-4dca-92f0-5877dd37841a could not be found. Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7af8ceec-fc69-4dca-92f0-5877dd37841a could not be found. Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d3c08e14-ff44-42f5-b77b-b3579857d852 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Returning 404 to user: Volume 7af8ceec-fc69-4dca-92f0-5877dd37841a could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d3c08e14-ff44-42f5-b77b-b3579857d852 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/7af8ceec-fc69-4dca-92f0-5877dd37841a" status: 404 len: 109 microversion: 2.1 time: 0.174048 Aug 05 07:13:50.436387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 7/7] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 5 07:13:50 2022] DELETE /compute/v2.1/os-volumes/7af8ceec-fc69-4dca-92f0-5877dd37841a => generated 109 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:13:50.443873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8084e569-10f8-4eec-8125-dd84ad7e4471 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Calling method '.version_select at 0x7f4971cdcd30>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:13:50.560592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-273f1a65-28a0-4ad8-a93b-212edadec37c tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.980354 Aug 05 07:13:50.561762 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 1/8] 10.222.0.27 () {60 vars in 1156 bytes} [Fri Aug 5 07:13:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2984 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 07:13:50.578000 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cfdee625-bd62-4c16-b7a2-3d81fe343a47 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] Calling method '.version_select at 0x7f4971dc5c10>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:13:50.782510 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-8084e569-10f8-4eec-8125-dd84ad7e4471 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] HTTP exception thrown: Volume d8185933-b562-40ca-ae95-2db9ebbb6c71 could not be found. Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8084e569-10f8-4eec-8125-dd84ad7e4471 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Request method failure captured: Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/os-volumes/d8185933-b562-40ca-ae95-2db9ebbb6c71 HTTP/1.1 Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MMrDt1FzNA_chTnw4HAOlPcUUOsIReYt-3LCZUcwr03Gq9T32bxfwQZPPsY03L906-aqgui_x8YaTE7LBH0SgCRWTyxQO19WXOu-3YyBtSNN8zzmGrSbnLw7hdxudtz_ZhX6JJR_9Ew7-8EsnPyEWVcC7gA9VWHKRaUB1mX7-F4sKQ Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: efa588d5331d4d0b9ade4c0af72eac8d Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:13:50.787846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efa588d5331d4d0b9ade4c0af72eac8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efa588d5331d4d0b9ade4c0af72eac8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: efa588d5331d4d0b9ade4c0af72eac8d Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-VolumesNegativeTest-1473649575 Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-VolumesNegativeTest-1473649575-project Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: fd2a5862bd074a548ca0189107777cc9 Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-VolumesNegativeTest-1473649575-project Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Volume d8185933-b562-40ca-ae95-2db9ebbb6c71 could not be found. Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'd8185933-b562-40ca-ae95-2db9ebbb6c71'} Aug 05 07:13:50.789497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8185933-b562-40ca-ae95-2db9ebbb6c71 could not be found. (HTTP 404) (Request-ID: req-4524a8c7-ea76-445d-8d5f-8cba9b819f73) Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:50.790381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 07:13:50.791649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8185933-b562-40ca-ae95-2db9ebbb6c71 could not be found. Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 07:13:50.792949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:13:50.794261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8185933-b562-40ca-ae95-2db9ebbb6c71 could not be found. Aug 05 07:13:50.794261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.794261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:50.794261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.794261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:50.794261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:50.794261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:50.794261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:13:50.794261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:13:50.794261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8185933-b562-40ca-ae95-2db9ebbb6c71 could not be found. Aug 05 07:13:50.794261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:13:50.797126 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8084e569-10f8-4eec-8125-dd84ad7e4471 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] Returning 404 to user: Volume d8185933-b562-40ca-ae95-2db9ebbb6c71 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:13:50.798208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8084e569-10f8-4eec-8125-dd84ad7e4471 tempest-VolumesNegativeTest-1473649575 tempest-VolumesNegativeTest-1473649575-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d8185933-b562-40ca-ae95-2db9ebbb6c71" status: 404 len: 109 microversion: 2.1 time: 0.359016 Aug 05 07:13:50.809662 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 8/9] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:13:50 2022] GET /compute/v2.1/os-volumes/d8185933-b562-40ca-ae95-2db9ebbb6c71 => generated 109 bytes in 371 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:13:50.864606 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cfdee625-bd62-4c16-b7a2-3d81fe343a47 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752" status: 200 len: 353 microversion: 2.1 time: 0.292130 Aug 05 07:13:50.871172 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 2/10] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:13:50 2022] GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752 => generated 353 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:13:51.888557 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-03a44e48-ecf1-455b-aea8-532ba266c18f tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] Calling method '.version_select at 0x7f4971d93280>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:13:52.034401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-03a44e48-ecf1-455b-aea8-532ba266c18f tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752" status: 200 len: 353 microversion: 2.1 time: 0.139669 Aug 05 07:13:52.034401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 9/11] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:13:51 2022] GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752 => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:13:53.038114 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-44f8819f-5942-4f1b-997b-f763c0ba0316 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] Calling method '.version_select at 0x7f4971d62310>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:13:53.157519 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-44f8819f-5942-4f1b-997b-f763c0ba0316 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752" status: 200 len: 354 microversion: 2.1 time: 0.128126 Aug 05 07:13:53.158297 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 3/12] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:13:53 2022] GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752 => generated 354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:13:53.171245 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7e0a39f7-5db8-4d38-b60f-dad06225c0a6 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] Calling method '.version_select at 0x7f4971cdc1f0>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:13:53.286975 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7e0a39f7-5db8-4d38-b60f-dad06225c0a6 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752" status: 200 len: 354 microversion: 2.1 time: 0.119722 Aug 05 07:13:53.287944 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 10/13] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:13:53 2022] GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752 => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:13:53.336478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4e26ed3f-e122-459a-a3eb-2b9c23758047 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] Calling method '.version_select at 0x7f4971d629d0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:13:53.496317 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4e26ed3f-e122-459a-a3eb-2b9c23758047 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752" status: 202 len: 0 microversion: 2.1 time: 0.192829 Aug 05 07:13:53.496877 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 4/14] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 5 07:13:53 2022] DELETE /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:13:53.505719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-eb7e8db4-d83c-4eb7-84c2-3c121e0af86d tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] Calling method '.version_select at 0x7f4971cfb280>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:13:53.646440 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-eb7e8db4-d83c-4eb7-84c2-3c121e0af86d tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752" status: 200 len: 353 microversion: 2.1 time: 0.144779 Aug 05 07:13:53.652766 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 11/15] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:13:53 2022] GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752 => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:13:54.661312 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ea7cbfd9-6746-4d46-8240-e6ea81db49f7 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] Calling method '.version_select at 0x7f4971dc5dc0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:13:54.729896 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-ea7cbfd9-6746-4d46-8240-e6ea81db49f7 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] HTTP exception thrown: Volume ca7df905-e4ba-4215-af88-e2026495d752 could not be found. Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ea7cbfd9-6746-4d46-8240-e6ea81db49f7 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] Request method failure captured: Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752 HTTP/1.1 Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MMrmFTtkKpAKxIC9msltjtmcvS3AoNfBwKS7Dswyt_jb4XU3DyXcKCFEoKVZPoyYXaAUb-MgZ8aeTqB4G3qo5Jvajf1E-fwg28kfM64ifgE5LZGUSI6xMVfs7ZwX7ikjcDcNlH18bWwioptgZizXDxa13eUgXUYtVZe2sK-7KRFt1w Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: fd750a5a13ab4cb690b328abdd67872c Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesGetTestJSON-1560582191 Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:13:54.735377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fd750a5a13ab4cb690b328abdd67872c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd750a5a13ab4cb690b328abdd67872c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd750a5a13ab4cb690b328abdd67872c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fd750a5a13ab4cb690b328abdd67872c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesGetTestJSON-1560582191 Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: fd750a5a13ab4cb690b328abdd67872c Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesGetTestJSON-1560582191 Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesGetTestJSON-1560582191-project Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: fbd4cecd32204f9fa60348534afa5217 Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesGetTestJSON-1560582191-project Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Volume ca7df905-e4ba-4215-af88-e2026495d752 could not be found. Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'ca7df905-e4ba-4215-af88-e2026495d752'} Aug 05 07:13:54.736765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca7df905-e4ba-4215-af88-e2026495d752 could not be found. (HTTP 404) (Request-ID: req-eddae35f-a0b4-423f-9afa-31ec70974f5f) Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:54.737650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 07:13:54.738790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca7df905-e4ba-4215-af88-e2026495d752 could not be found. Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 07:13:54.739808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:13:54.741427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca7df905-e4ba-4215-af88-e2026495d752 could not be found. Aug 05 07:13:54.741427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:13:54.741427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:13:54.741427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:13:54.741427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:13:54.741427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:13:54.741427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:13:54.741427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:13:54.741427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:13:54.741427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca7df905-e4ba-4215-af88-e2026495d752 could not be found. Aug 05 07:13:54.741427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:13:54.743489 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ea7cbfd9-6746-4d46-8240-e6ea81db49f7 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] Returning 404 to user: Volume ca7df905-e4ba-4215-af88-e2026495d752 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:13:54.744788 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ea7cbfd9-6746-4d46-8240-e6ea81db49f7 tempest-VolumesGetTestJSON-1560582191 tempest-VolumesGetTestJSON-1560582191-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752" status: 404 len: 109 microversion: 2.1 time: 0.087301 Aug 05 07:13:54.746351 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 5/16] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:13:54 2022] GET /compute/v2.1/os-volumes/ca7df905-e4ba-4215-af88-e2026495d752 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:13:57.423330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f31dd7e2-2dd6-426b-84b4-17d9588e238d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: .version_select at 0x7f4971cfb8b0>, body: {"keypair": {"name": "tempest-keypair-1980436844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXe4RjgWAqgDK9Ah6InuqLpFlQq8EJuVgkaRNrcbusRmrNUEUCVjoA0e8k4cebuQWiHudkHjLlpwOd1Dt1p9ITW8XsxEpVLllv6otPnGPeEj5Q4CUXb0ybWNUesA6BJBg=="}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:13:57.587094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-f31dd7e2-2dd6-426b-84b4-17d9588e238d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for project 61bf4a49abd8479f895e68d4954412b2. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:13:57.605372 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-f31dd7e2-2dd6-426b-84b4-17d9588e238d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for user 096d0da1a0bc401c95bfbb8fc150a27b and project 61bf4a49abd8479f895e68d4954412b2. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:13:57.758473 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f31dd7e2-2dd6-426b-84b4-17d9588e238d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.578122 Aug 05 07:13:57.760103 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 12/17] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 5 07:13:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:14:05.813248 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-615094914", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "470083bd-345d-480f-9634-dd509ffd0df2"}], "security_groups": [{"name": "tempest-securitygroup--1434840761"}], "key_name": "tempest-keypair-1980436844", "user_data": "}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:14:06.289910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] validate_networks() for [('470083bd-345d-480f-9634-dd509ffd0df2', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:14:07.141311 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1954257538", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:14:07.382675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] validate_networks() for [('18d11307-47f7-43be-968f-d57a0e95c587', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:14:07.638456 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=4 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:09.210268 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:14:09.211860 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:14:09.212556 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:14:09.213291 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:14:09.214095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:14:09.232736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:09.233717 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:09.237036 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:09.238153 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:09.238839 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:09.239461 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:09.319608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:14:09.320209 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:14:09.320560 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:14:09.320996 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:14:09.322022 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:14:09.328664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Getting quotas for project fe39edf907ff48518759474a800b949d. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:14:09.343048 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Getting quotas for user 2ce8bf4f0ab64010b3855193f55971d2 and project fe39edf907ff48518759474a800b949d. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:14:09.369906 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:14:09.374965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:09.377171 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:09.379512 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:09.380676 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:09.381014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:14:09.383296 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:09.384841 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:09.476484 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for project 61bf4a49abd8479f895e68d4954412b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:14:09.487085 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for user 096d0da1a0bc401c95bfbb8fc150a27b and project 61bf4a49abd8479f895e68d4954412b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:14:09.507860 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:14:09.514007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:14:09.550111 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8fe7bd10-948e-47d7-ad82-e75f33ebdc8f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.024174 Aug 05 07:14:09.552501 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 13/18] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:14:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 3034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:14:09.857548 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3f2eee40-0662-4167-9533-ca37997867b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.049408 Aug 05 07:14:09.861280 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 6/19] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:14:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 4057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:14:10.002768 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5775fac7-1c97-41dc-9e4a-2330500cb7d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Action: 'create', calling method: .version_select at 0x7f49713a0280>, body: {"keypair": {"name": "tempest-keypair-1145748143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfzJIxAuJXlhQyzVbGtvL5ATPQtBAvHYVQifYVdO+ngaKgwJJq9fYZD16M0hUfJcl5bdd9J5ACtfQ9/D9VwqiPletiJ4hWVVgrFkp+twm2xarCc1W6rp0vX7JYTgw1CHw=="}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:14:10.077163 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-5775fac7-1c97-41dc-9e4a-2330500cb7d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Getting quotas for project 92e23c5c336e486f995f88c12b72b2c5. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:14:10.083675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-5775fac7-1c97-41dc-9e4a-2330500cb7d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Getting quotas for user 02c685b300874351ab2dbd62bea1a669 and project 92e23c5c336e486f995f88c12b72b2c5. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:14:10.144508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5775fac7-1c97-41dc-9e4a-2330500cb7d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.589555 Aug 05 07:14:10.147633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 14/20] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 5 07:14:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:14:10.161781 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-86c19e4d-2f54-4164-9d79-fb2bbec2e13e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:10.170871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-86c19e4d-2f54-4164-9d79-fb2bbec2e13e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:10.281230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1136881072", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "networks": [{"uuid": "d6ad7441-01a4-4f76-9640-3a0f4855774e"}]}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:14:10.451305 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] validate_networks() for [('d6ad7441-01a4-4f76-9640-3a0f4855774e', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:14:10.494545 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-86c19e4d-2f54-4164-9d79-fb2bbec2e13e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:10.536528 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-86c19e4d-2f54-4164-9d79-fb2bbec2e13e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1222 microversion: 2.1 time: 0.387193 Aug 05 07:14:10.539495 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 15/21] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:10 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1222 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:10.550511 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1268bde5-c902-40ef-b569-f129478d35e6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:10.553186 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1268bde5-c902-40ef-b569-f129478d35e6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:10.703102 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1268bde5-c902-40ef-b569-f129478d35e6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:10.724136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1268bde5-c902-40ef-b569-f129478d35e6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1241 microversion: 2.1 time: 0.180391 Aug 05 07:14:10.728636 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 16/22] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:10 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:11.067389 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1944610822", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:14:11.195785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] validate_networks() for [('18d11307-47f7-43be-968f-d57a0e95c587', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:14:12.898431 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:14:12.899728 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:14:12.900457 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:14:12.901109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:14:12.901788 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:14:12.919151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:12.921472 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:12.923927 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:12.925006 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:12.926145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:12.929427 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:12.978836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Getting quotas for project fe39edf907ff48518759474a800b949d. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:14:12.986908 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Getting quotas for user 2ce8bf4f0ab64010b3855193f55971d2 and project fe39edf907ff48518759474a800b949d. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:14:13.011880 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:14:13.014536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:14:13.126827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5944a7c4-4c82-4e05-80ab-06e09efa7805 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.065856 Aug 05 07:14:13.128220 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 17/23] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:14:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:14:13.134824 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-880c5444-6c35-4603-a2a6-6ac28fb64fc0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:13.136498 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-880c5444-6c35-4603-a2a6-6ac28fb64fc0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:13.146318 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-880c5444-6c35-4603-a2a6-6ac28fb64fc0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:13.147028 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-880c5444-6c35-4603-a2a6-6ac28fb64fc0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:13.147518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-880c5444-6c35-4603-a2a6-6ac28fb64fc0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:13.148276 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-880c5444-6c35-4603-a2a6-6ac28fb64fc0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:13.149019 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-880c5444-6c35-4603-a2a6-6ac28fb64fc0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:13.150356 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-880c5444-6c35-4603-a2a6-6ac28fb64fc0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:13.271779 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:14:13.272324 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:14:13.272716 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:14:13.273181 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:14:13.273586 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:14:13.299104 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:13.299557 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:13.300372 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:13.301186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:13.304751 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:13.305445 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:13.386450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Getting quotas for project ab8827c8710749d387f23d4ce8b35fd4. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:14:13.391506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Getting quotas for user 9cedcecb65ea45aa8b37797907d69009 and project ab8827c8710749d387f23d4ce8b35fd4. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:14:13.417507 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:14:13.419731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:14:13.530176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7982a810-ad0e-4d09-9bb2-6acd9cb9265a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.666256 Aug 05 07:14:13.531474 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 7/24] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:14:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:14:13.540560 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e71aa20d-e3dd-4719-a039-8bc14bf62d25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:13.542368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e71aa20d-e3dd-4719-a039-8bc14bf62d25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:13.674619 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-880c5444-6c35-4603-a2a6-6ac28fb64fc0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:13.704080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-880c5444-6c35-4603-a2a6-6ac28fb64fc0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1293 microversion: 2.1 time: 0.571383 Aug 05 07:14:13.727678 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 18/25] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:13 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1293 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:13.741402 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ab47967f-5818-40c6-b8ee-e2dc9900d0a9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:13.746831 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ab47967f-5818-40c6-b8ee-e2dc9900d0a9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:13.938506 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ab47967f-5818-40c6-b8ee-e2dc9900d0a9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:13.950460 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ab47967f-5818-40c6-b8ee-e2dc9900d0a9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1215 microversion: 2.1 time: 0.219378 Aug 05 07:14:13.952341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 19/26] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:13 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:14.189861 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e71aa20d-e3dd-4719-a039-8bc14bf62d25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:14.243481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e71aa20d-e3dd-4719-a039-8bc14bf62d25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1222 microversion: 2.1 time: 0.707137 Aug 05 07:14:14.254696 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 8/27] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:13 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1222 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:14.731007 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-45e5c79d-c354-4b6f-b070-42e7ba682465 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:14.732186 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-45e5c79d-c354-4b6f-b070-42e7ba682465 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:14.746355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45e5c79d-c354-4b6f-b070-42e7ba682465 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:14.749852 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45e5c79d-c354-4b6f-b070-42e7ba682465 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:14.753593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45e5c79d-c354-4b6f-b070-42e7ba682465 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:14.756678 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45e5c79d-c354-4b6f-b070-42e7ba682465 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:14.760001 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45e5c79d-c354-4b6f-b070-42e7ba682465 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:14.764170 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45e5c79d-c354-4b6f-b070-42e7ba682465 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:14.974321 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-75f0535f-b96b-448d-949b-8266570b65eb tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:14.975502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-75f0535f-b96b-448d-949b-8266570b65eb tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:14.998377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-75f0535f-b96b-448d-949b-8266570b65eb tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:15.000208 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-75f0535f-b96b-448d-949b-8266570b65eb tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:15.002347 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-75f0535f-b96b-448d-949b-8266570b65eb tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:15.004783 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-75f0535f-b96b-448d-949b-8266570b65eb tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:15.006578 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-75f0535f-b96b-448d-949b-8266570b65eb tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:15.007072 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-75f0535f-b96b-448d-949b-8266570b65eb tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:15.053503 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-45e5c79d-c354-4b6f-b070-42e7ba682465 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:15.072140 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-45e5c79d-c354-4b6f-b070-42e7ba682465 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1299 microversion: 2.1 time: 0.336884 Aug 05 07:14:15.097276 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 20/28] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:14 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1299 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:15.269006 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a01b6a52-3563-4d13-a885-503c7d6d2270 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:15.271784 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a01b6a52-3563-4d13-a885-503c7d6d2270 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:15.292508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a01b6a52-3563-4d13-a885-503c7d6d2270 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:15.294864 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a01b6a52-3563-4d13-a885-503c7d6d2270 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:15.298040 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a01b6a52-3563-4d13-a885-503c7d6d2270 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:15.301531 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a01b6a52-3563-4d13-a885-503c7d6d2270 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:15.302989 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a01b6a52-3563-4d13-a885-503c7d6d2270 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:15.304504 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a01b6a52-3563-4d13-a885-503c7d6d2270 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:15.610423 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-75f0535f-b96b-448d-949b-8266570b65eb tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:15.631991 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-75f0535f-b96b-448d-949b-8266570b65eb tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1211 microversion: 2.1 time: 0.662730 Aug 05 07:14:15.645112 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 9/29] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:14 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1211 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:16.044486 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a01b6a52-3563-4d13-a885-503c7d6d2270 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:16.064366 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a01b6a52-3563-4d13-a885-503c7d6d2270 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1282 microversion: 2.1 time: 0.800211 Aug 05 07:14:16.067627 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 21/30] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:15 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1282 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:16.099730 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2401ec5a-8944-4fd7-a50e-2ad7d254a85c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:16.100393 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2401ec5a-8944-4fd7-a50e-2ad7d254a85c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:16.108573 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2401ec5a-8944-4fd7-a50e-2ad7d254a85c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:16.109137 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2401ec5a-8944-4fd7-a50e-2ad7d254a85c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:16.109582 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2401ec5a-8944-4fd7-a50e-2ad7d254a85c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:16.110300 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2401ec5a-8944-4fd7-a50e-2ad7d254a85c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:16.110763 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2401ec5a-8944-4fd7-a50e-2ad7d254a85c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:16.111191 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2401ec5a-8944-4fd7-a50e-2ad7d254a85c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:16.624526 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2401ec5a-8944-4fd7-a50e-2ad7d254a85c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:16.634049 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2401ec5a-8944-4fd7-a50e-2ad7d254a85c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1299 microversion: 2.1 time: 0.538614 Aug 05 07:14:16.642090 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 10/31] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:16 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1299 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:16.661418 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-02124328-9d24-426e-9ad8-801ba47d42a7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:16.662471 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-02124328-9d24-426e-9ad8-801ba47d42a7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:16.690184 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-02124328-9d24-426e-9ad8-801ba47d42a7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:16.691843 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-02124328-9d24-426e-9ad8-801ba47d42a7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:16.694447 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-02124328-9d24-426e-9ad8-801ba47d42a7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:16.700005 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-02124328-9d24-426e-9ad8-801ba47d42a7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:16.701077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-02124328-9d24-426e-9ad8-801ba47d42a7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:16.703266 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-02124328-9d24-426e-9ad8-801ba47d42a7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:17.087822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-87d30d92-9a3a-4c4c-b0bd-f9b7af341110 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:17.088881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-87d30d92-9a3a-4c4c-b0bd-f9b7af341110 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:17.097700 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87d30d92-9a3a-4c4c-b0bd-f9b7af341110 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:17.111127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87d30d92-9a3a-4c4c-b0bd-f9b7af341110 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:17.111650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87d30d92-9a3a-4c4c-b0bd-f9b7af341110 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:17.112477 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87d30d92-9a3a-4c4c-b0bd-f9b7af341110 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:17.114274 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87d30d92-9a3a-4c4c-b0bd-f9b7af341110 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:17.115028 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87d30d92-9a3a-4c4c-b0bd-f9b7af341110 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:17.626677 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-02124328-9d24-426e-9ad8-801ba47d42a7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:17.670647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-02124328-9d24-426e-9ad8-801ba47d42a7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1273 microversion: 2.1 time: 1.006962 Aug 05 07:14:17.672418 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 22/32] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:16 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1273 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:17.690322 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-bd61b54d-9c02-4053-afe7-48930c40048c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:17.695150 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-bd61b54d-9c02-4053-afe7-48930c40048c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:17.723048 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bd61b54d-9c02-4053-afe7-48930c40048c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:17.723555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bd61b54d-9c02-4053-afe7-48930c40048c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:17.724005 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bd61b54d-9c02-4053-afe7-48930c40048c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:17.724733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bd61b54d-9c02-4053-afe7-48930c40048c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:17.725233 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bd61b54d-9c02-4053-afe7-48930c40048c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:17.735180 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bd61b54d-9c02-4053-afe7-48930c40048c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:17.798734 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-87d30d92-9a3a-4c4c-b0bd-f9b7af341110 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:17.814540 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-87d30d92-9a3a-4c4c-b0bd-f9b7af341110 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1280 microversion: 2.1 time: 0.724002 Aug 05 07:14:17.815239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 11/33] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:17 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1280 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:18.066731 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-bd61b54d-9c02-4053-afe7-48930c40048c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:18.100923 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-bd61b54d-9c02-4053-afe7-48930c40048c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1299 microversion: 2.1 time: 0.426974 Aug 05 07:14:18.117346 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 23/34] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:17 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1299 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:18.699605 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-de1a6ba3-2cfd-4bc1-8bea-282fd198d3d5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:18.701400 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-de1a6ba3-2cfd-4bc1-8bea-282fd198d3d5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:18.721225 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de1a6ba3-2cfd-4bc1-8bea-282fd198d3d5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:18.723440 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de1a6ba3-2cfd-4bc1-8bea-282fd198d3d5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:18.727702 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de1a6ba3-2cfd-4bc1-8bea-282fd198d3d5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:18.736178 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de1a6ba3-2cfd-4bc1-8bea-282fd198d3d5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:18.738336 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de1a6ba3-2cfd-4bc1-8bea-282fd198d3d5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:18.739014 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de1a6ba3-2cfd-4bc1-8bea-282fd198d3d5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:18.839805 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-69297fce-97d3-482a-9886-a5db2c46cc72 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:18.841154 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-69297fce-97d3-482a-9886-a5db2c46cc72 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:18.844416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=8 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:18.884461 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-69297fce-97d3-482a-9886-a5db2c46cc72 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:18.885344 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-69297fce-97d3-482a-9886-a5db2c46cc72 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:18.885968 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-69297fce-97d3-482a-9886-a5db2c46cc72 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:18.896627 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-69297fce-97d3-482a-9886-a5db2c46cc72 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:18.897778 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-69297fce-97d3-482a-9886-a5db2c46cc72 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:18.898689 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-69297fce-97d3-482a-9886-a5db2c46cc72 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:19.143789 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-de1a6ba3-2cfd-4bc1-8bea-282fd198d3d5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:19.161707 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-de1a6ba3-2cfd-4bc1-8bea-282fd198d3d5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1273 microversion: 2.1 time: 0.463458 Aug 05 07:14:19.162459 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 12/35] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:18 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1273 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:19.186637 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3309018c-7ad3-467e-8069-135c84197b9d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:19.189422 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3309018c-7ad3-467e-8069-135c84197b9d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:19.213866 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3309018c-7ad3-467e-8069-135c84197b9d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:19.218761 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3309018c-7ad3-467e-8069-135c84197b9d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:19.221911 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3309018c-7ad3-467e-8069-135c84197b9d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:19.229035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3309018c-7ad3-467e-8069-135c84197b9d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:19.234902 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3309018c-7ad3-467e-8069-135c84197b9d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:19.236356 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3309018c-7ad3-467e-8069-135c84197b9d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:19.338256 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-69297fce-97d3-482a-9886-a5db2c46cc72 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:19.355481 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-69297fce-97d3-482a-9886-a5db2c46cc72 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1280 microversion: 2.1 time: 0.522710 Aug 05 07:14:19.362691 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 24/36] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:18 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1280 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:19.427342 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3309018c-7ad3-467e-8069-135c84197b9d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:19.452482 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3309018c-7ad3-467e-8069-135c84197b9d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1299 microversion: 2.1 time: 0.286183 Aug 05 07:14:19.472436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 13/37] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:19 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1299 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:19.730582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1454012752", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94bcede7-f992-4709-94b9-11856148fea6"}], "security_groups": [{"name": "tempest-securitygroup--1932122732"}], "key_name": "tempest-keypair-1145748143", "user_data": "}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:14:20.184165 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d6c3a43c-aff1-4fa1-935e-2e13985d8ed7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:20.184958 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d6c3a43c-aff1-4fa1-935e-2e13985d8ed7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:20.199889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6c3a43c-aff1-4fa1-935e-2e13985d8ed7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:20.200381 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6c3a43c-aff1-4fa1-935e-2e13985d8ed7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:20.200820 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6c3a43c-aff1-4fa1-935e-2e13985d8ed7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:20.204964 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6c3a43c-aff1-4fa1-935e-2e13985d8ed7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:20.205448 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6c3a43c-aff1-4fa1-935e-2e13985d8ed7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:20.205884 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6c3a43c-aff1-4fa1-935e-2e13985d8ed7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:20.525439 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d6c3a43c-aff1-4fa1-935e-2e13985d8ed7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:20.544704 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d6c3a43c-aff1-4fa1-935e-2e13985d8ed7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1273 microversion: 2.1 time: 0.361414 Aug 05 07:14:20.548207 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 14/38] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:20 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1273 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:20.596523 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0bbc34b4-8461-4ff1-90fa-6d53d3c24a63 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:20.597180 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0bbc34b4-8461-4ff1-90fa-6d53d3c24a63 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:20.664748 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0bbc34b4-8461-4ff1-90fa-6d53d3c24a63 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:20.685671 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0bbc34b4-8461-4ff1-90fa-6d53d3c24a63 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:20.687929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0bbc34b4-8461-4ff1-90fa-6d53d3c24a63 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:20.690904 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0bbc34b4-8461-4ff1-90fa-6d53d3c24a63 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:20.695794 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0bbc34b4-8461-4ff1-90fa-6d53d3c24a63 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:20.699128 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0bbc34b4-8461-4ff1-90fa-6d53d3c24a63 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:20.895462 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] validate_networks() for [('94bcede7-f992-4709-94b9-11856148fea6', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:14:21.889156 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0bbc34b4-8461-4ff1-90fa-6d53d3c24a63 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:21.909192 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0bbc34b4-8461-4ff1-90fa-6d53d3c24a63 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 1.354542 Aug 05 07:14:21.910742 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 15/39] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:20 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:21.922916 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ae2c36b0-3aa4-495b-b0b6-f3bd2b06e7d7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:21.927036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ae2c36b0-3aa4-495b-b0b6-f3bd2b06e7d7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:21.968014 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae2c36b0-3aa4-495b-b0b6-f3bd2b06e7d7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:21.971109 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae2c36b0-3aa4-495b-b0b6-f3bd2b06e7d7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:21.971624 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae2c36b0-3aa4-495b-b0b6-f3bd2b06e7d7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:21.972387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae2c36b0-3aa4-495b-b0b6-f3bd2b06e7d7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:21.977121 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae2c36b0-3aa4-495b-b0b6-f3bd2b06e7d7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:21.977919 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae2c36b0-3aa4-495b-b0b6-f3bd2b06e7d7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:22.530487 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ae2c36b0-3aa4-495b-b0b6-f3bd2b06e7d7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:22.538780 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ae2c36b0-3aa4-495b-b0b6-f3bd2b06e7d7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.625024 Aug 05 07:14:22.542739 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 16/40] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:21 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:22.551942 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-773f4226-3267-438e-8963-cd87186d8087 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:22.552566 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-773f4226-3267-438e-8963-cd87186d8087 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:22.585048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-773f4226-3267-438e-8963-cd87186d8087 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:22.588301 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-773f4226-3267-438e-8963-cd87186d8087 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:22.594262 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-773f4226-3267-438e-8963-cd87186d8087 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:22.595443 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-773f4226-3267-438e-8963-cd87186d8087 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:22.597671 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-773f4226-3267-438e-8963-cd87186d8087 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:22.599060 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-773f4226-3267-438e-8963-cd87186d8087 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:22.948418 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=4 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:23.342456 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=4 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:23.818661 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-773f4226-3267-438e-8963-cd87186d8087 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:23.833683 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-773f4226-3267-438e-8963-cd87186d8087 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 1.284433 Aug 05 07:14:23.835531 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 17/41] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:22 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:23.857334 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a2507521-aff5-4f3b-a492-ed4f57b5002a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:23.859352 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a2507521-aff5-4f3b-a492-ed4f57b5002a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:23.868507 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2507521-aff5-4f3b-a492-ed4f57b5002a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:23.869401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2507521-aff5-4f3b-a492-ed4f57b5002a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:23.870010 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2507521-aff5-4f3b-a492-ed4f57b5002a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:23.873822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2507521-aff5-4f3b-a492-ed4f57b5002a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:23.874695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2507521-aff5-4f3b-a492-ed4f57b5002a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:23.875472 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2507521-aff5-4f3b-a492-ed4f57b5002a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:23.945436 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=22 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:24.219128 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=14 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:24.484511 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a2507521-aff5-4f3b-a492-ed4f57b5002a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:24.499917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a2507521-aff5-4f3b-a492-ed4f57b5002a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.662513 Aug 05 07:14:24.507707 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 18/42] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:23 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:24.523954 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6af24c49-6ee0-437b-87e7-f96b96be2c04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:24.535822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6af24c49-6ee0-437b-87e7-f96b96be2c04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:24.563280 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6af24c49-6ee0-437b-87e7-f96b96be2c04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:24.563815 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6af24c49-6ee0-437b-87e7-f96b96be2c04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:24.564324 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6af24c49-6ee0-437b-87e7-f96b96be2c04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:24.565064 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6af24c49-6ee0-437b-87e7-f96b96be2c04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:24.565915 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6af24c49-6ee0-437b-87e7-f96b96be2c04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:24.566055 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6af24c49-6ee0-437b-87e7-f96b96be2c04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:24.678696 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:14:24.680594 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:14:24.682014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:14:24.683023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:14:24.684010 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:14:24.719408 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:24.722453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:24.723585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:24.724706 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:24.728758 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:24.731988 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:24.780480 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Getting quotas for project 92e23c5c336e486f995f88c12b72b2c5. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:14:24.806947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Getting quotas for user 02c685b300874351ab2dbd62bea1a669 and project 92e23c5c336e486f995f88c12b72b2c5. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:14:24.848938 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:14:24.851953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:14:24.996820 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-38c7944a-31d9-45c1-a85d-8fab069fa6d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.270648 Aug 05 07:14:24.998179 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 25/43] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:14:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 5274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:14:25.003562 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-149d75c9-219f-4829-9af2-534f698313a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:25.011694 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-149d75c9-219f-4829-9af2-534f698313a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:25.020058 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-149d75c9-219f-4829-9af2-534f698313a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:25.020875 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-149d75c9-219f-4829-9af2-534f698313a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:25.021558 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-149d75c9-219f-4829-9af2-534f698313a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:25.022430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-149d75c9-219f-4829-9af2-534f698313a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:25.023081 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-149d75c9-219f-4829-9af2-534f698313a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:25.023661 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-149d75c9-219f-4829-9af2-534f698313a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:25.638756 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6af24c49-6ee0-437b-87e7-f96b96be2c04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:25.641281 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6af24c49-6ee0-437b-87e7-f96b96be2c04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 1.129347 Aug 05 07:14:25.647676 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 19/44] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:24 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:25.671460 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a29cabdf-3168-4e16-bf1c-2d37e8418355 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:25.685027 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a29cabdf-3168-4e16-bf1c-2d37e8418355 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:25.977511 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a29cabdf-3168-4e16-bf1c-2d37e8418355 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:25.994560 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a29cabdf-3168-4e16-bf1c-2d37e8418355 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1238 microversion: 2.1 time: 0.345478 Aug 05 07:14:26.003007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 20/45] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:25 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1238 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:26.131878 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-149d75c9-219f-4829-9af2-534f698313a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:26.143427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-e86032d1-5696-4660-8237-db33bb5fd3a9 req-af51cc9a-c623-4a22-80e1-e1bc25f6b63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f899e07a-87f6-4228-9dc1-c92ec3eed017", "tag": "ca9499bf-08de-46eb-b235-f09c2fccac1d"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:14:26.146754 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-149d75c9-219f-4829-9af2-534f698313a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 1.144248 Aug 05 07:14:26.149871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 26/46] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:24 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:26.162297 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e86032d1-5696-4660-8237-db33bb5fd3a9 req-af51cc9a-c623-4a22-80e1-e1bc25f6b63a service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:26.162727 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c4c98a8e-bac4-4d2d-b88a-15732d93f035 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:26.162923 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c4c98a8e-bac4-4d2d-b88a-15732d93f035 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:26.163762 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e86032d1-5696-4660-8237-db33bb5fd3a9 req-af51cc9a-c623-4a22-80e1-e1bc25f6b63a service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:26.164555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e86032d1-5696-4660-8237-db33bb5fd3a9 req-af51cc9a-c623-4a22-80e1-e1bc25f6b63a service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:26.176757 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c4c98a8e-bac4-4d2d-b88a-15732d93f035 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:26.179150 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c4c98a8e-bac4-4d2d-b88a-15732d93f035 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:26.189600 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c4c98a8e-bac4-4d2d-b88a-15732d93f035 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:26.193525 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c4c98a8e-bac4-4d2d-b88a-15732d93f035 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:26.194367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c4c98a8e-bac4-4d2d-b88a-15732d93f035 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:26.194809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c4c98a8e-bac4-4d2d-b88a-15732d93f035 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:26.207342 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-e86032d1-5696-4660-8237-db33bb5fd3a9 req-af51cc9a-c623-4a22-80e1-e1bc25f6b63a service nova] Creating event network-changed:ca9499bf-08de-46eb-b235-f09c2fccac1d for instance f899e07a-87f6-4228-9dc1-c92ec3eed017 on hv-cinder-85200 Aug 05 07:14:26.208402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e86032d1-5696-4660-8237-db33bb5fd3a9 req-af51cc9a-c623-4a22-80e1-e1bc25f6b63a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117893) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 07:14:26.209057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e86032d1-5696-4660-8237-db33bb5fd3a9 req-af51cc9a-c623-4a22-80e1-e1bc25f6b63a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117893) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 07:14:26.210365 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd49f5ca-6999-42d0-831b-7fb453c9b470 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:26.211170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd49f5ca-6999-42d0-831b-7fb453c9b470 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:26.211820 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd49f5ca-6999-42d0-831b-7fb453c9b470 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:26.212774 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd49f5ca-6999-42d0-831b-7fb453c9b470 None None] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:26.213639 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd49f5ca-6999-42d0-831b-7fb453c9b470 None None] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:26.214444 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd49f5ca-6999-42d0-831b-7fb453c9b470 None None] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:26.225235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.compute.rpcapi [None req-bd49f5ca-6999-42d0-831b-7fb453c9b470 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 07:14:26.226510 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd49f5ca-6999-42d0-831b-7fb453c9b470 None None] Releasing lock "compute-rpcapi-router" {{(pid=117893) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 07:14:26.286198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bd49f5ca-6999-42d0-831b-7fb453c9b470 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281559 Aug 05 07:14:26.287389 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 21/47] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:14:26.670160 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-575ee005-09f1-428a-95a5-1a2acd262dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:26.671909 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-575ee005-09f1-428a-95a5-1a2acd262dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:26.679999 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c4c98a8e-bac4-4d2d-b88a-15732d93f035 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:26.681486 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-575ee005-09f1-428a-95a5-1a2acd262dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:26.682610 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-575ee005-09f1-428a-95a5-1a2acd262dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:26.683518 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-575ee005-09f1-428a-95a5-1a2acd262dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:26.684716 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-575ee005-09f1-428a-95a5-1a2acd262dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:26.685749 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-575ee005-09f1-428a-95a5-1a2acd262dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:26.686377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-575ee005-09f1-428a-95a5-1a2acd262dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:26.693770 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c4c98a8e-bac4-4d2d-b88a-15732d93f035 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.541665 Aug 05 07:14:26.694555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 27/48] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:26 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:26.909990 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-575ee005-09f1-428a-95a5-1a2acd262dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:26.926400 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-575ee005-09f1-428a-95a5-1a2acd262dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.261567 Aug 05 07:14:26.927770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 22/49] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:26 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:27.021502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-74441f2d-1357-439e-9c61-b0b77fa6bac9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:27.022132 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-74441f2d-1357-439e-9c61-b0b77fa6bac9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:27.032651 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-74441f2d-1357-439e-9c61-b0b77fa6bac9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:27.033169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-74441f2d-1357-439e-9c61-b0b77fa6bac9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:27.033609 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-74441f2d-1357-439e-9c61-b0b77fa6bac9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:27.034381 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-74441f2d-1357-439e-9c61-b0b77fa6bac9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:27.034824 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-74441f2d-1357-439e-9c61-b0b77fa6bac9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:27.035163 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-74441f2d-1357-439e-9c61-b0b77fa6bac9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:27.068144 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-154ec788-5440-412d-bd7c-6c92ee06bf4a req-2e6b7eda-1189-4176-b652-1481089cdbef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c3c22d-3c48-4d1b-8ee9-29c1e3268147", "tag": "27f2f9c3-a397-478f-89d5-adb7b9c5e4af"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:14:27.085246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-154ec788-5440-412d-bd7c-6c92ee06bf4a req-2e6b7eda-1189-4176-b652-1481089cdbef service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:27.086178 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-154ec788-5440-412d-bd7c-6c92ee06bf4a req-2e6b7eda-1189-4176-b652-1481089cdbef service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:27.086778 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-154ec788-5440-412d-bd7c-6c92ee06bf4a req-2e6b7eda-1189-4176-b652-1481089cdbef service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:27.109495 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-154ec788-5440-412d-bd7c-6c92ee06bf4a req-2e6b7eda-1189-4176-b652-1481089cdbef service nova] Creating event network-changed:27f2f9c3-a397-478f-89d5-adb7b9c5e4af for instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 on hv-cinder-85200 Aug 05 07:14:27.110323 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-154ec788-5440-412d-bd7c-6c92ee06bf4a req-2e6b7eda-1189-4176-b652-1481089cdbef service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117894) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 07:14:27.110715 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-154ec788-5440-412d-bd7c-6c92ee06bf4a req-2e6b7eda-1189-4176-b652-1481089cdbef service nova] Acquired lock "compute-rpcapi-router" {{(pid=117894) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 07:14:27.111787 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be547b20-990e-4abc-9d26-897a3f1af991 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:27.112215 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-74441f2d-1357-439e-9c61-b0b77fa6bac9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:27.112350 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be547b20-990e-4abc-9d26-897a3f1af991 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:27.112662 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be547b20-990e-4abc-9d26-897a3f1af991 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:27.113415 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be547b20-990e-4abc-9d26-897a3f1af991 None None] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:27.113865 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be547b20-990e-4abc-9d26-897a3f1af991 None None] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:27.114280 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be547b20-990e-4abc-9d26-897a3f1af991 None None] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:27.122167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-74441f2d-1357-439e-9c61-b0b77fa6bac9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1242 microversion: 2.1 time: 0.104830 Aug 05 07:14:27.123225 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 23/50] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:27 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:27.126321 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.compute.rpcapi [None req-be547b20-990e-4abc-9d26-897a3f1af991 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 07:14:27.127871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be547b20-990e-4abc-9d26-897a3f1af991 None None] Releasing lock "compute-rpcapi-router" {{(pid=117894) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 07:14:27.151075 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-be547b20-990e-4abc-9d26-897a3f1af991 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182421 Aug 05 07:14:27.152197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 28/51] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:14:27.172933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-caf2bbf1-ab92-4a2c-9747-1f984f44b1ba tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:27.173686 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-caf2bbf1-ab92-4a2c-9747-1f984f44b1ba tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:27.180264 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-caf2bbf1-ab92-4a2c-9747-1f984f44b1ba tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:27.180836 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-caf2bbf1-ab92-4a2c-9747-1f984f44b1ba tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:27.181361 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-caf2bbf1-ab92-4a2c-9747-1f984f44b1ba tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:27.182124 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-caf2bbf1-ab92-4a2c-9747-1f984f44b1ba tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:27.182638 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-caf2bbf1-ab92-4a2c-9747-1f984f44b1ba tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:27.183126 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-caf2bbf1-ab92-4a2c-9747-1f984f44b1ba tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:27.331369 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-caf2bbf1-ab92-4a2c-9747-1f984f44b1ba tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:27.348130 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-caf2bbf1-ab92-4a2c-9747-1f984f44b1ba tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.179862 Aug 05 07:14:27.348864 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 24/52] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:27 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:27.715889 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-02cd0bc5-c79e-4c9b-910e-185cf3dbfa2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:27.716744 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-02cd0bc5-c79e-4c9b-910e-185cf3dbfa2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:27.724511 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-02cd0bc5-c79e-4c9b-910e-185cf3dbfa2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:27.725326 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-02cd0bc5-c79e-4c9b-910e-185cf3dbfa2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:27.726009 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-02cd0bc5-c79e-4c9b-910e-185cf3dbfa2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:27.726957 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-02cd0bc5-c79e-4c9b-910e-185cf3dbfa2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:27.727638 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-02cd0bc5-c79e-4c9b-910e-185cf3dbfa2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:27.728294 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-02cd0bc5-c79e-4c9b-910e-185cf3dbfa2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:27.943640 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-02cd0bc5-c79e-4c9b-910e-185cf3dbfa2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:27.953751 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dc2a566c-3cef-4d9a-a2ce-4fd168b15d67 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:27.955201 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dc2a566c-3cef-4d9a-a2ce-4fd168b15d67 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:27.959707 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-02cd0bc5-c79e-4c9b-910e-185cf3dbfa2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.248170 Aug 05 07:14:27.960202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 29/53] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:27 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:27.965288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc2a566c-3cef-4d9a-a2ce-4fd168b15d67 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:27.966078 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc2a566c-3cef-4d9a-a2ce-4fd168b15d67 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:27.966731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc2a566c-3cef-4d9a-a2ce-4fd168b15d67 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:27.967445 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc2a566c-3cef-4d9a-a2ce-4fd168b15d67 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:27.967901 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc2a566c-3cef-4d9a-a2ce-4fd168b15d67 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:27.968329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc2a566c-3cef-4d9a-a2ce-4fd168b15d67 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:28.146890 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4c4e33ec-dd6b-48ef-b1cd-941630978b5d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:28.147837 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4c4e33ec-dd6b-48ef-b1cd-941630978b5d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:28.157478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dc2a566c-3cef-4d9a-a2ce-4fd168b15d67 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:28.163160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4c4e33ec-dd6b-48ef-b1cd-941630978b5d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:28.164089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4c4e33ec-dd6b-48ef-b1cd-941630978b5d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:28.164256 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4c4e33ec-dd6b-48ef-b1cd-941630978b5d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:28.164846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4c4e33ec-dd6b-48ef-b1cd-941630978b5d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:28.167607 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4c4e33ec-dd6b-48ef-b1cd-941630978b5d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:28.168210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4c4e33ec-dd6b-48ef-b1cd-941630978b5d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:28.171201 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-dc2a566c-3cef-4d9a-a2ce-4fd168b15d67 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.222625 Aug 05 07:14:28.180946 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 25/54] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:27 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:28.253395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4c4e33ec-dd6b-48ef-b1cd-941630978b5d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:28.263003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4c4e33ec-dd6b-48ef-b1cd-941630978b5d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1242 microversion: 2.1 time: 0.122469 Aug 05 07:14:28.263793 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 30/55] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:28 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:28.374626 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-45c294a9-94f8-46f3-81ef-7e76580c9201 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:28.374856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-45c294a9-94f8-46f3-81ef-7e76580c9201 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:28.395770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45c294a9-94f8-46f3-81ef-7e76580c9201 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:28.398218 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45c294a9-94f8-46f3-81ef-7e76580c9201 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:28.398218 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45c294a9-94f8-46f3-81ef-7e76580c9201 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:28.398885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45c294a9-94f8-46f3-81ef-7e76580c9201 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:28.402960 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45c294a9-94f8-46f3-81ef-7e76580c9201 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:28.412442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45c294a9-94f8-46f3-81ef-7e76580c9201 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:28.417180 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:28.629644 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-45c294a9-94f8-46f3-81ef-7e76580c9201 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:28.639112 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-45c294a9-94f8-46f3-81ef-7e76580c9201 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.268993 Aug 05 07:14:28.640034 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 26/56] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:28 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:28.985031 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f4f1679c-a50c-46b5-bd75-6c5a69bb4a7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:28.985953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f4f1679c-a50c-46b5-bd75-6c5a69bb4a7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:28.992533 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f4f1679c-a50c-46b5-bd75-6c5a69bb4a7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:28.993207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f4f1679c-a50c-46b5-bd75-6c5a69bb4a7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:28.994089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f4f1679c-a50c-46b5-bd75-6c5a69bb4a7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:28.995397 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f4f1679c-a50c-46b5-bd75-6c5a69bb4a7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:28.996325 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f4f1679c-a50c-46b5-bd75-6c5a69bb4a7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:28.996881 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f4f1679c-a50c-46b5-bd75-6c5a69bb4a7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:29.136142 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f4f1679c-a50c-46b5-bd75-6c5a69bb4a7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:29.144670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f4f1679c-a50c-46b5-bd75-6c5a69bb4a7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.166836 Aug 05 07:14:29.145390 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 31/57] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:28 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:29.195055 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8de75de0-beb8-4eeb-b06c-bc81c73251b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:29.196337 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8de75de0-beb8-4eeb-b06c-bc81c73251b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:29.206497 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8de75de0-beb8-4eeb-b06c-bc81c73251b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:29.206986 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8de75de0-beb8-4eeb-b06c-bc81c73251b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:29.207465 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8de75de0-beb8-4eeb-b06c-bc81c73251b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:29.208349 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8de75de0-beb8-4eeb-b06c-bc81c73251b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:29.208795 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8de75de0-beb8-4eeb-b06c-bc81c73251b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:29.209299 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8de75de0-beb8-4eeb-b06c-bc81c73251b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:29.256269 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-d0072e6a-8d13-48f1-9606-99cedcbc706a req-607aeae0-9afa-472c-b27d-1faa49137164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8759583-2a52-42ed-a5e0-c72a7000b211", "tag": "1869529c-7cd6-42c5-9f0a-5d9ae0e48a24"}, {"name": "network-changed", "server_uuid": "076d8f98-2ac9-4f41-ad6b-41eaa1428706", "tag": "a999eb01-1d23-4a60-b75e-1af095c98abc"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:14:29.269148 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-d0072e6a-8d13-48f1-9606-99cedcbc706a req-607aeae0-9afa-472c-b27d-1faa49137164 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:29.270468 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-d0072e6a-8d13-48f1-9606-99cedcbc706a req-607aeae0-9afa-472c-b27d-1faa49137164 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:29.271197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-d0072e6a-8d13-48f1-9606-99cedcbc706a req-607aeae0-9afa-472c-b27d-1faa49137164 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:29.293759 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-d0072e6a-8d13-48f1-9606-99cedcbc706a req-607aeae0-9afa-472c-b27d-1faa49137164 service nova] Creating event network-changed:1869529c-7cd6-42c5-9f0a-5d9ae0e48a24 for instance c8759583-2a52-42ed-a5e0-c72a7000b211 on hv-cinder-85200 Aug 05 07:14:29.298348 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-d0072e6a-8d13-48f1-9606-99cedcbc706a req-607aeae0-9afa-472c-b27d-1faa49137164 service nova] Creating event network-changed:a999eb01-1d23-4a60-b75e-1af095c98abc for instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 on hv-cinder-85200 Aug 05 07:14:29.307456 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-d0072e6a-8d13-48f1-9606-99cedcbc706a req-607aeae0-9afa-472c-b27d-1faa49137164 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054977 Aug 05 07:14:29.308954 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 32/58] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:14:29.317737 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0caab251-9034-4697-8266-dbc782795b56 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:29.318709 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0caab251-9034-4697-8266-dbc782795b56 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:29.328607 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0caab251-9034-4697-8266-dbc782795b56 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:29.329149 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0caab251-9034-4697-8266-dbc782795b56 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:29.329658 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0caab251-9034-4697-8266-dbc782795b56 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:29.330296 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0caab251-9034-4697-8266-dbc782795b56 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:29.330749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0caab251-9034-4697-8266-dbc782795b56 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:29.331175 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0caab251-9034-4697-8266-dbc782795b56 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:29.370262 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8de75de0-beb8-4eeb-b06c-bc81c73251b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:29.381456 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8de75de0-beb8-4eeb-b06c-bc81c73251b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.190501 Aug 05 07:14:29.382113 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 27/59] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:29 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:29.420413 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0caab251-9034-4697-8266-dbc782795b56 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:29.428930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0caab251-9034-4697-8266-dbc782795b56 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1242 microversion: 2.1 time: 0.118352 Aug 05 07:14:29.436217 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 33/60] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:29 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:29.660536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4d6b4ec9-69b9-4717-8abc-d5054888c21c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:29.661397 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4d6b4ec9-69b9-4717-8abc-d5054888c21c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:29.669761 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4d6b4ec9-69b9-4717-8abc-d5054888c21c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:29.670426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4d6b4ec9-69b9-4717-8abc-d5054888c21c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:29.671020 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4d6b4ec9-69b9-4717-8abc-d5054888c21c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:29.671857 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4d6b4ec9-69b9-4717-8abc-d5054888c21c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:29.672437 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4d6b4ec9-69b9-4717-8abc-d5054888c21c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:29.673017 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4d6b4ec9-69b9-4717-8abc-d5054888c21c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:29.877498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4d6b4ec9-69b9-4717-8abc-d5054888c21c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:29.889135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4d6b4ec9-69b9-4717-8abc-d5054888c21c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.232152 Aug 05 07:14:29.894466 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 28/61] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:29 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:30.170437 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-89b08da9-5b4b-40ca-94ee-fa7b3a732b5d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:30.171269 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-89b08da9-5b4b-40ca-94ee-fa7b3a732b5d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:30.177879 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-89b08da9-5b4b-40ca-94ee-fa7b3a732b5d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:30.181746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-89b08da9-5b4b-40ca-94ee-fa7b3a732b5d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:30.182632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-89b08da9-5b4b-40ca-94ee-fa7b3a732b5d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:30.183601 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-89b08da9-5b4b-40ca-94ee-fa7b3a732b5d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:30.184496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-89b08da9-5b4b-40ca-94ee-fa7b3a732b5d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:30.184936 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-89b08da9-5b4b-40ca-94ee-fa7b3a732b5d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:30.412404 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3e3d3d5e-aa3d-4242-8cb6-e82e69a7712f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:30.413060 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3e3d3d5e-aa3d-4242-8cb6-e82e69a7712f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:30.426886 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e3d3d5e-aa3d-4242-8cb6-e82e69a7712f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:30.428148 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e3d3d5e-aa3d-4242-8cb6-e82e69a7712f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:30.428599 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e3d3d5e-aa3d-4242-8cb6-e82e69a7712f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:30.435071 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e3d3d5e-aa3d-4242-8cb6-e82e69a7712f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:30.435632 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e3d3d5e-aa3d-4242-8cb6-e82e69a7712f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:30.436524 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e3d3d5e-aa3d-4242-8cb6-e82e69a7712f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:30.479279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-89b08da9-5b4b-40ca-94ee-fa7b3a732b5d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:30.495238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-89b08da9-5b4b-40ca-94ee-fa7b3a732b5d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.327419 Aug 05 07:14:30.495996 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 34/62] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:30 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:30.504691 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-29279c46-82f7-4b47-9c92-028db3e67fa5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:30.505939 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-29279c46-82f7-4b47-9c92-028db3e67fa5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:30.524777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-29279c46-82f7-4b47-9c92-028db3e67fa5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:30.527734 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-29279c46-82f7-4b47-9c92-028db3e67fa5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:30.528970 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-29279c46-82f7-4b47-9c92-028db3e67fa5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:30.531580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-29279c46-82f7-4b47-9c92-028db3e67fa5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:30.532296 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-29279c46-82f7-4b47-9c92-028db3e67fa5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:30.533503 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-29279c46-82f7-4b47-9c92-028db3e67fa5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:30.755920 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-29279c46-82f7-4b47-9c92-028db3e67fa5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:30.761925 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3e3d3d5e-aa3d-4242-8cb6-e82e69a7712f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:30.768985 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-29279c46-82f7-4b47-9c92-028db3e67fa5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1242 microversion: 2.1 time: 0.271446 Aug 05 07:14:30.771018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3e3d3d5e-aa3d-4242-8cb6-e82e69a7712f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.363105 Aug 05 07:14:30.772886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 35/63] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:30 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1242 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:30.788089 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 29/64] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:30 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:30.911265 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d0cc818e-4f02-40c0-873c-80e9236dae66 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:30.911959 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d0cc818e-4f02-40c0-873c-80e9236dae66 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:30.920992 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d0cc818e-4f02-40c0-873c-80e9236dae66 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:30.926849 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d0cc818e-4f02-40c0-873c-80e9236dae66 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:30.927461 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d0cc818e-4f02-40c0-873c-80e9236dae66 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:30.928535 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d0cc818e-4f02-40c0-873c-80e9236dae66 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:30.929167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d0cc818e-4f02-40c0-873c-80e9236dae66 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:30.929893 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d0cc818e-4f02-40c0-873c-80e9236dae66 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:30.965434 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:31.253160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d0cc818e-4f02-40c0-873c-80e9236dae66 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:31.262535 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d0cc818e-4f02-40c0-873c-80e9236dae66 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.355307 Aug 05 07:14:31.264080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 36/65] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:30 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:31.516654 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a5bebd53-7799-41e8-bd54-5297f78edd11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:31.518106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a5bebd53-7799-41e8-bd54-5297f78edd11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:31.533093 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5bebd53-7799-41e8-bd54-5297f78edd11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:31.534314 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5bebd53-7799-41e8-bd54-5297f78edd11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:31.535666 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5bebd53-7799-41e8-bd54-5297f78edd11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:31.538565 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5bebd53-7799-41e8-bd54-5297f78edd11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:31.539293 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5bebd53-7799-41e8-bd54-5297f78edd11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:31.542008 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5bebd53-7799-41e8-bd54-5297f78edd11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:31.798639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b8cb2a85-3948-475b-8531-11cc981eb2b2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:31.801184 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b8cb2a85-3948-475b-8531-11cc981eb2b2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:31.820446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b8cb2a85-3948-475b-8531-11cc981eb2b2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:31.829746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b8cb2a85-3948-475b-8531-11cc981eb2b2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:31.831371 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b8cb2a85-3948-475b-8531-11cc981eb2b2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:31.832316 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b8cb2a85-3948-475b-8531-11cc981eb2b2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:31.832794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b8cb2a85-3948-475b-8531-11cc981eb2b2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:31.844249 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b8cb2a85-3948-475b-8531-11cc981eb2b2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:31.928772 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a5bebd53-7799-41e8-bd54-5297f78edd11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:31.948540 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a5bebd53-7799-41e8-bd54-5297f78edd11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.436269 Aug 05 07:14:31.973923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 30/66] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:31 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:32.001994 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b8cb2a85-3948-475b-8531-11cc981eb2b2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:32.005204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cbbe4ce5-8dcb-47d4-9de7-ff01bfec2fa7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:32.008338 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cbbe4ce5-8dcb-47d4-9de7-ff01bfec2fa7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:32.015988 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b8cb2a85-3948-475b-8531-11cc981eb2b2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1242 microversion: 2.1 time: 0.225530 Aug 05 07:14:32.017385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 37/67] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:31 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1242 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:32.018718 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cbbe4ce5-8dcb-47d4-9de7-ff01bfec2fa7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:32.019411 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cbbe4ce5-8dcb-47d4-9de7-ff01bfec2fa7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:32.019853 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cbbe4ce5-8dcb-47d4-9de7-ff01bfec2fa7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:32.026032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cbbe4ce5-8dcb-47d4-9de7-ff01bfec2fa7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:32.028826 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cbbe4ce5-8dcb-47d4-9de7-ff01bfec2fa7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:32.036624 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cbbe4ce5-8dcb-47d4-9de7-ff01bfec2fa7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:32.291386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8e9a0c86-6850-4579-9dbd-082109ffd857 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:32.292098 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8e9a0c86-6850-4579-9dbd-082109ffd857 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:32.309034 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e9a0c86-6850-4579-9dbd-082109ffd857 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:32.310005 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e9a0c86-6850-4579-9dbd-082109ffd857 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:32.311724 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e9a0c86-6850-4579-9dbd-082109ffd857 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:32.314755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cbbe4ce5-8dcb-47d4-9de7-ff01bfec2fa7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:32.314991 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e9a0c86-6850-4579-9dbd-082109ffd857 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:32.315267 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e9a0c86-6850-4579-9dbd-082109ffd857 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:32.316224 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e9a0c86-6850-4579-9dbd-082109ffd857 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:32.338783 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cbbe4ce5-8dcb-47d4-9de7-ff01bfec2fa7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.359720 Aug 05 07:14:32.340140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 31/68] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:31 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:32.745658 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-8e9a0c86-6850-4579-9dbd-082109ffd857 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:32.754187 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8e9a0c86-6850-4579-9dbd-082109ffd857 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.469325 Aug 05 07:14:32.768372 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 38/69] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:32 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:32.975854 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-26df07f6-a41a-4d50-a6f2-6faa34b52a7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:32.976460 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-26df07f6-a41a-4d50-a6f2-6faa34b52a7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:32.983155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26df07f6-a41a-4d50-a6f2-6faa34b52a7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:32.984018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26df07f6-a41a-4d50-a6f2-6faa34b52a7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:32.985039 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26df07f6-a41a-4d50-a6f2-6faa34b52a7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:32.986029 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26df07f6-a41a-4d50-a6f2-6faa34b52a7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:32.986686 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26df07f6-a41a-4d50-a6f2-6faa34b52a7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:32.987313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26df07f6-a41a-4d50-a6f2-6faa34b52a7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:33.043597 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e60fef97-37a4-4668-b11f-00f79f3f923e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:33.045447 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e60fef97-37a4-4668-b11f-00f79f3f923e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:33.052671 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e60fef97-37a4-4668-b11f-00f79f3f923e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:33.053547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e60fef97-37a4-4668-b11f-00f79f3f923e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:33.054762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e60fef97-37a4-4668-b11f-00f79f3f923e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:33.055973 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e60fef97-37a4-4668-b11f-00f79f3f923e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:33.056419 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e60fef97-37a4-4668-b11f-00f79f3f923e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:33.056846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e60fef97-37a4-4668-b11f-00f79f3f923e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:33.139261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e60fef97-37a4-4668-b11f-00f79f3f923e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:33.147272 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e60fef97-37a4-4668-b11f-00f79f3f923e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1242 microversion: 2.1 time: 0.109617 Aug 05 07:14:33.157432 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 39/70] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:33 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:33.240085 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-26df07f6-a41a-4d50-a6f2-6faa34b52a7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:33.248102 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-26df07f6-a41a-4d50-a6f2-6faa34b52a7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.277339 Aug 05 07:14:33.260253 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 32/71] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:32 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:33.360562 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3135083d-015e-44eb-a45a-be79647b6b89 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:33.361122 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3135083d-015e-44eb-a45a-be79647b6b89 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:33.367566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3135083d-015e-44eb-a45a-be79647b6b89 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:33.368028 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3135083d-015e-44eb-a45a-be79647b6b89 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:33.368467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3135083d-015e-44eb-a45a-be79647b6b89 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:33.369195 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3135083d-015e-44eb-a45a-be79647b6b89 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:33.369761 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3135083d-015e-44eb-a45a-be79647b6b89 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:33.370189 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3135083d-015e-44eb-a45a-be79647b6b89 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:33.520254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3135083d-015e-44eb-a45a-be79647b6b89 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:33.531126 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3135083d-015e-44eb-a45a-be79647b6b89 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.175093 Aug 05 07:14:33.533350 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 40/72] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:33 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:33.781778 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-18cf9504-1824-43b3-9212-777e69385ed6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:33.782429 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-18cf9504-1824-43b3-9212-777e69385ed6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:33.802550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18cf9504-1824-43b3-9212-777e69385ed6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:33.803948 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18cf9504-1824-43b3-9212-777e69385ed6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:33.805497 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18cf9504-1824-43b3-9212-777e69385ed6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:33.806234 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18cf9504-1824-43b3-9212-777e69385ed6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:33.806693 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18cf9504-1824-43b3-9212-777e69385ed6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:33.807108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18cf9504-1824-43b3-9212-777e69385ed6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:34.135759 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-18cf9504-1824-43b3-9212-777e69385ed6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:34.150826 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-18cf9504-1824-43b3-9212-777e69385ed6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.378933 Aug 05 07:14:34.151429 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 33/73] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:33 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:34.168182 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-01faf9b8-c764-4734-9d71-7054c842bc96 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:34.168877 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-01faf9b8-c764-4734-9d71-7054c842bc96 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:34.175395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-01faf9b8-c764-4734-9d71-7054c842bc96 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:34.175892 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-01faf9b8-c764-4734-9d71-7054c842bc96 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:34.176316 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-01faf9b8-c764-4734-9d71-7054c842bc96 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:34.177067 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-01faf9b8-c764-4734-9d71-7054c842bc96 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:34.177524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-01faf9b8-c764-4734-9d71-7054c842bc96 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:34.177940 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-01faf9b8-c764-4734-9d71-7054c842bc96 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:34.250801 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-01faf9b8-c764-4734-9d71-7054c842bc96 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:34.259190 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-01faf9b8-c764-4734-9d71-7054c842bc96 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1234 microversion: 2.1 time: 0.094836 Aug 05 07:14:34.259855 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 41/74] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:34 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1234 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:34.283117 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-be22da1d-fbc7-4cc4-ba22-5f570e0df48b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:34.284176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-be22da1d-fbc7-4cc4-ba22-5f570e0df48b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:34.291013 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be22da1d-fbc7-4cc4-ba22-5f570e0df48b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:34.291869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be22da1d-fbc7-4cc4-ba22-5f570e0df48b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:34.292561 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be22da1d-fbc7-4cc4-ba22-5f570e0df48b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:34.293746 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be22da1d-fbc7-4cc4-ba22-5f570e0df48b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:34.294446 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be22da1d-fbc7-4cc4-ba22-5f570e0df48b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:34.295076 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be22da1d-fbc7-4cc4-ba22-5f570e0df48b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:34.461081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-be22da1d-fbc7-4cc4-ba22-5f570e0df48b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:34.468775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-be22da1d-fbc7-4cc4-ba22-5f570e0df48b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.198786 Aug 05 07:14:34.469398 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 34/75] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:34 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:34.553949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d26fa756-7976-47b3-bdf1-cf058050c2dc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:34.554557 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d26fa756-7976-47b3-bdf1-cf058050c2dc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:34.560872 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d26fa756-7976-47b3-bdf1-cf058050c2dc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:34.561623 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d26fa756-7976-47b3-bdf1-cf058050c2dc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:34.562046 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d26fa756-7976-47b3-bdf1-cf058050c2dc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:34.562764 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d26fa756-7976-47b3-bdf1-cf058050c2dc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:34.563209 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d26fa756-7976-47b3-bdf1-cf058050c2dc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:34.563627 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d26fa756-7976-47b3-bdf1-cf058050c2dc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:34.707522 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d26fa756-7976-47b3-bdf1-cf058050c2dc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:34.716178 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d26fa756-7976-47b3-bdf1-cf058050c2dc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.166043 Aug 05 07:14:34.717221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 42/76] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:34 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:35.173005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6dc680d9-657d-43cf-815b-659a7e56fa4b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:35.174058 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6dc680d9-657d-43cf-815b-659a7e56fa4b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:35.180733 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6dc680d9-657d-43cf-815b-659a7e56fa4b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:35.181246 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6dc680d9-657d-43cf-815b-659a7e56fa4b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:35.181681 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6dc680d9-657d-43cf-815b-659a7e56fa4b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:35.182370 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6dc680d9-657d-43cf-815b-659a7e56fa4b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:35.182824 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6dc680d9-657d-43cf-815b-659a7e56fa4b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:35.183244 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6dc680d9-657d-43cf-815b-659a7e56fa4b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:35.280123 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-bf947579-5493-49e5-965b-4e910d78ea86 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:35.281568 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-bf947579-5493-49e5-965b-4e910d78ea86 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:35.290525 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=6 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:35.292486 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf947579-5493-49e5-965b-4e910d78ea86 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:35.293006 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf947579-5493-49e5-965b-4e910d78ea86 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:35.293842 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf947579-5493-49e5-965b-4e910d78ea86 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:35.294890 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf947579-5493-49e5-965b-4e910d78ea86 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:35.295432 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf947579-5493-49e5-965b-4e910d78ea86 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:35.296014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf947579-5493-49e5-965b-4e910d78ea86 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:35.325932 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6dc680d9-657d-43cf-815b-659a7e56fa4b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:35.334240 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6dc680d9-657d-43cf-815b-659a7e56fa4b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.165207 Aug 05 07:14:35.334817 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 35/77] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:35 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:35.374304 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-bf947579-5493-49e5-965b-4e910d78ea86 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:35.382639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-bf947579-5493-49e5-965b-4e910d78ea86 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1234 microversion: 2.1 time: 0.106783 Aug 05 07:14:35.383217 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 43/78] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:35 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1234 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:35.489905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b088d8ee-c2dd-411e-a2c6-3cb1baca6a6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:35.490599 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b088d8ee-c2dd-411e-a2c6-3cb1baca6a6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:35.496718 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b088d8ee-c2dd-411e-a2c6-3cb1baca6a6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:35.497237 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b088d8ee-c2dd-411e-a2c6-3cb1baca6a6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:35.497680 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b088d8ee-c2dd-411e-a2c6-3cb1baca6a6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:35.498492 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b088d8ee-c2dd-411e-a2c6-3cb1baca6a6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:35.498940 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b088d8ee-c2dd-411e-a2c6-3cb1baca6a6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:35.499359 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b088d8ee-c2dd-411e-a2c6-3cb1baca6a6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:35.641520 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b088d8ee-c2dd-411e-a2c6-3cb1baca6a6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:35.649335 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b088d8ee-c2dd-411e-a2c6-3cb1baca6a6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.163173 Aug 05 07:14:35.649919 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 36/79] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:35 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:35.747496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2486631f-edec-423a-9c98-4c83115c6080 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:35.749486 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2486631f-edec-423a-9c98-4c83115c6080 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:35.761364 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2486631f-edec-423a-9c98-4c83115c6080 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:35.762040 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2486631f-edec-423a-9c98-4c83115c6080 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:35.762544 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2486631f-edec-423a-9c98-4c83115c6080 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:35.763558 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2486631f-edec-423a-9c98-4c83115c6080 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:35.764094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2486631f-edec-423a-9c98-4c83115c6080 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:35.764682 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2486631f-edec-423a-9c98-4c83115c6080 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:35.914066 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2486631f-edec-423a-9c98-4c83115c6080 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:35.921718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2486631f-edec-423a-9c98-4c83115c6080 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.182259 Aug 05 07:14:35.922296 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 44/80] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:35 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:36.362571 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7b137537-329d-453b-b68c-5c80cbdca013 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:36.363125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7b137537-329d-453b-b68c-5c80cbdca013 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:36.364948 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:36.365629 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:36.366278 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:36.373509 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b137537-329d-453b-b68c-5c80cbdca013 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:36.374129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b137537-329d-453b-b68c-5c80cbdca013 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:36.374561 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b137537-329d-453b-b68c-5c80cbdca013 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:36.385542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b137537-329d-453b-b68c-5c80cbdca013 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:36.386034 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b137537-329d-453b-b68c-5c80cbdca013 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:36.386477 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b137537-329d-453b-b68c-5c80cbdca013 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:36.404346 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f9d90ab9-1309-462a-92cd-785880f84287 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:36.405089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f9d90ab9-1309-462a-92cd-785880f84287 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:36.416305 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f9d90ab9-1309-462a-92cd-785880f84287 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:36.416789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f9d90ab9-1309-462a-92cd-785880f84287 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:36.417272 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f9d90ab9-1309-462a-92cd-785880f84287 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:36.418937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f9d90ab9-1309-462a-92cd-785880f84287 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:36.418937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f9d90ab9-1309-462a-92cd-785880f84287 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:36.418937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f9d90ab9-1309-462a-92cd-785880f84287 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:36.509581 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f9d90ab9-1309-462a-92cd-785880f84287 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:36.518563 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f9d90ab9-1309-462a-92cd-785880f84287 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1234 microversion: 2.1 time: 0.119017 Aug 05 07:14:36.519164 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 45/81] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:36 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1234 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:36.566944 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7b137537-329d-453b-b68c-5c80cbdca013 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:36.574929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7b137537-329d-453b-b68c-5c80cbdca013 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.216379 Aug 05 07:14:36.575497 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 37/82] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:36 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:36.671108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f0c30370-012d-4db6-b4d7-16357d331e5a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:36.671622 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f0c30370-012d-4db6-b4d7-16357d331e5a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:36.678087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0c30370-012d-4db6-b4d7-16357d331e5a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:36.678564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0c30370-012d-4db6-b4d7-16357d331e5a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:36.678992 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0c30370-012d-4db6-b4d7-16357d331e5a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:36.679671 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0c30370-012d-4db6-b4d7-16357d331e5a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:36.680118 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0c30370-012d-4db6-b4d7-16357d331e5a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:36.680533 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0c30370-012d-4db6-b4d7-16357d331e5a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:36.838701 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f0c30370-012d-4db6-b4d7-16357d331e5a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:36.850575 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f0c30370-012d-4db6-b4d7-16357d331e5a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.183571 Aug 05 07:14:36.851157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 46/83] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:36 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:36.942428 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9c916c7f-af24-4ed2-82b3-c871313030bd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:36.942987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9c916c7f-af24-4ed2-82b3-c871313030bd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:36.949795 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c916c7f-af24-4ed2-82b3-c871313030bd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:36.950313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c916c7f-af24-4ed2-82b3-c871313030bd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:36.950782 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c916c7f-af24-4ed2-82b3-c871313030bd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:36.951462 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c916c7f-af24-4ed2-82b3-c871313030bd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:36.951909 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c916c7f-af24-4ed2-82b3-c871313030bd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:36.952320 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c916c7f-af24-4ed2-82b3-c871313030bd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:37.088971 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9c916c7f-af24-4ed2-82b3-c871313030bd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:37.096846 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9c916c7f-af24-4ed2-82b3-c871313030bd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.158517 Aug 05 07:14:37.097423 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 38/84] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:36 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:37.541686 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-dc2aa16f-425a-4099-8c95-006310b21680 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:37.542169 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-dc2aa16f-425a-4099-8c95-006310b21680 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:37.546222 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=4 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:37.551674 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc2aa16f-425a-4099-8c95-006310b21680 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:37.552403 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc2aa16f-425a-4099-8c95-006310b21680 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:37.552882 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc2aa16f-425a-4099-8c95-006310b21680 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:37.553600 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc2aa16f-425a-4099-8c95-006310b21680 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:37.554050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc2aa16f-425a-4099-8c95-006310b21680 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:37.554530 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc2aa16f-425a-4099-8c95-006310b21680 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:37.595897 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ebd40067-4a20-40ce-8a1f-3261bb87c4aa tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:37.596517 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ebd40067-4a20-40ce-8a1f-3261bb87c4aa tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:37.603001 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ebd40067-4a20-40ce-8a1f-3261bb87c4aa tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:37.603488 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ebd40067-4a20-40ce-8a1f-3261bb87c4aa tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:37.603925 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ebd40067-4a20-40ce-8a1f-3261bb87c4aa tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:37.604626 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ebd40067-4a20-40ce-8a1f-3261bb87c4aa tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:37.605103 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ebd40067-4a20-40ce-8a1f-3261bb87c4aa tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:37.605526 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ebd40067-4a20-40ce-8a1f-3261bb87c4aa tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:37.618154 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-dc2aa16f-425a-4099-8c95-006310b21680 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:37.626235 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-dc2aa16f-425a-4099-8c95-006310b21680 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1290 microversion: 2.1 time: 0.090310 Aug 05 07:14:37.627137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 47/85] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:37 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:37.737482 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ebd40067-4a20-40ce-8a1f-3261bb87c4aa tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:37.744961 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ebd40067-4a20-40ce-8a1f-3261bb87c4aa tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.153146 Aug 05 07:14:37.745533 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 39/86] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:37 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:37.873633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7f630145-0362-4ef2-aef5-9f884f561493 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:37.874503 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7f630145-0362-4ef2-aef5-9f884f561493 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:37.881757 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f630145-0362-4ef2-aef5-9f884f561493 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:37.882249 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f630145-0362-4ef2-aef5-9f884f561493 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:37.882688 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f630145-0362-4ef2-aef5-9f884f561493 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:37.883734 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f630145-0362-4ef2-aef5-9f884f561493 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:37.884334 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f630145-0362-4ef2-aef5-9f884f561493 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:37.884927 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f630145-0362-4ef2-aef5-9f884f561493 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:38.117904 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5a276aa7-a3a5-4bd7-a6c4-e6b6f6a264b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:38.118854 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5a276aa7-a3a5-4bd7-a6c4-e6b6f6a264b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:38.125157 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5a276aa7-a3a5-4bd7-a6c4-e6b6f6a264b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:38.125637 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5a276aa7-a3a5-4bd7-a6c4-e6b6f6a264b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:38.126066 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5a276aa7-a3a5-4bd7-a6c4-e6b6f6a264b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:38.126751 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5a276aa7-a3a5-4bd7-a6c4-e6b6f6a264b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:38.127193 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5a276aa7-a3a5-4bd7-a6c4-e6b6f6a264b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:38.127803 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5a276aa7-a3a5-4bd7-a6c4-e6b6f6a264b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:38.291944 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5a276aa7-a3a5-4bd7-a6c4-e6b6f6a264b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:38.301415 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5a276aa7-a3a5-4bd7-a6c4-e6b6f6a264b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.186939 Aug 05 07:14:38.309633 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 40/87] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:38 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:38.370073 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7f630145-0362-4ef2-aef5-9f884f561493 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:38.378630 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7f630145-0362-4ef2-aef5-9f884f561493 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.510235 Aug 05 07:14:38.379217 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 48/88] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:37 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:38.646876 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bcfa59c8-4c5f-490a-93db-c0b544d38923 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:38.647471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bcfa59c8-4c5f-490a-93db-c0b544d38923 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:38.656458 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bcfa59c8-4c5f-490a-93db-c0b544d38923 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:38.656945 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bcfa59c8-4c5f-490a-93db-c0b544d38923 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:38.657380 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bcfa59c8-4c5f-490a-93db-c0b544d38923 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:38.658169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bcfa59c8-4c5f-490a-93db-c0b544d38923 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:38.658851 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bcfa59c8-4c5f-490a-93db-c0b544d38923 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:38.659273 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bcfa59c8-4c5f-490a-93db-c0b544d38923 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:38.726353 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bcfa59c8-4c5f-490a-93db-c0b544d38923 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:38.734748 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bcfa59c8-4c5f-490a-93db-c0b544d38923 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1308 microversion: 2.1 time: 0.091649 Aug 05 07:14:38.735315 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 41/89] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:38 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:38.766095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0bf3fe71-567a-41c9-916d-45e541e2ec8a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:38.766646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0bf3fe71-567a-41c9-916d-45e541e2ec8a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:38.772710 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bf3fe71-567a-41c9-916d-45e541e2ec8a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:38.773220 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bf3fe71-567a-41c9-916d-45e541e2ec8a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:38.773645 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bf3fe71-567a-41c9-916d-45e541e2ec8a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:38.774327 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bf3fe71-567a-41c9-916d-45e541e2ec8a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:38.774773 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bf3fe71-567a-41c9-916d-45e541e2ec8a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:38.775183 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bf3fe71-567a-41c9-916d-45e541e2ec8a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:38.913898 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0bf3fe71-567a-41c9-916d-45e541e2ec8a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:38.921805 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0bf3fe71-567a-41c9-916d-45e541e2ec8a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.159800 Aug 05 07:14:38.922406 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 49/90] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:38 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:39.322228 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-160254a8-d8dd-4205-8d74-85aa6050c0d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:39.323019 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-160254a8-d8dd-4205-8d74-85aa6050c0d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:39.329494 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-160254a8-d8dd-4205-8d74-85aa6050c0d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:39.330058 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-160254a8-d8dd-4205-8d74-85aa6050c0d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:39.330580 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-160254a8-d8dd-4205-8d74-85aa6050c0d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:39.331362 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-160254a8-d8dd-4205-8d74-85aa6050c0d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:39.331805 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-160254a8-d8dd-4205-8d74-85aa6050c0d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:39.332473 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-160254a8-d8dd-4205-8d74-85aa6050c0d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:39.403414 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c8efb65c-8e58-4a80-b247-b1a30e2b8f7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:39.403414 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c8efb65c-8e58-4a80-b247-b1a30e2b8f7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:39.407111 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8efb65c-8e58-4a80-b247-b1a30e2b8f7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:39.407610 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8efb65c-8e58-4a80-b247-b1a30e2b8f7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:39.408211 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8efb65c-8e58-4a80-b247-b1a30e2b8f7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:39.408911 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8efb65c-8e58-4a80-b247-b1a30e2b8f7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:39.409367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8efb65c-8e58-4a80-b247-b1a30e2b8f7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:39.409836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8efb65c-8e58-4a80-b247-b1a30e2b8f7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:39.488406 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-160254a8-d8dd-4205-8d74-85aa6050c0d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:39.492118 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:39.497304 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-160254a8-d8dd-4205-8d74-85aa6050c0d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.179111 Aug 05 07:14:39.497926 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 42/91] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:39 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:39.548290 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c8efb65c-8e58-4a80-b247-b1a30e2b8f7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:39.556860 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c8efb65c-8e58-4a80-b247-b1a30e2b8f7d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.161440 Aug 05 07:14:39.557463 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 50/92] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:39 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:39.757177 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-aec35f31-2f14-412f-89a2-05fb51ca0dd8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:39.758018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-aec35f31-2f14-412f-89a2-05fb51ca0dd8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:39.764149 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aec35f31-2f14-412f-89a2-05fb51ca0dd8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:39.764627 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aec35f31-2f14-412f-89a2-05fb51ca0dd8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:39.765080 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aec35f31-2f14-412f-89a2-05fb51ca0dd8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:39.765766 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aec35f31-2f14-412f-89a2-05fb51ca0dd8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:39.766209 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aec35f31-2f14-412f-89a2-05fb51ca0dd8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:39.766605 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aec35f31-2f14-412f-89a2-05fb51ca0dd8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:39.830732 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aec35f31-2f14-412f-89a2-05fb51ca0dd8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:39.838682 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-aec35f31-2f14-412f-89a2-05fb51ca0dd8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1308 microversion: 2.1 time: 0.086588 Aug 05 07:14:39.839274 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 43/93] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:39 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1308 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:39.943886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-39646e70-8964-4a01-bd42-2de0c0432c40 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:39.944513 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-39646e70-8964-4a01-bd42-2de0c0432c40 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:39.950898 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-39646e70-8964-4a01-bd42-2de0c0432c40 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:39.951386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-39646e70-8964-4a01-bd42-2de0c0432c40 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:39.951816 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-39646e70-8964-4a01-bd42-2de0c0432c40 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:39.952477 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-39646e70-8964-4a01-bd42-2de0c0432c40 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:39.953134 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-39646e70-8964-4a01-bd42-2de0c0432c40 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:39.953556 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-39646e70-8964-4a01-bd42-2de0c0432c40 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:40.096330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-39646e70-8964-4a01-bd42-2de0c0432c40 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:40.105878 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-39646e70-8964-4a01-bd42-2de0c0432c40 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.166564 Aug 05 07:14:40.106490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 51/94] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:39 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:40.517786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9113bdfd-296f-4426-84f0-8f7d2521bd4e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:40.518398 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9113bdfd-296f-4426-84f0-8f7d2521bd4e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:40.524932 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9113bdfd-296f-4426-84f0-8f7d2521bd4e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:40.525789 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9113bdfd-296f-4426-84f0-8f7d2521bd4e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:40.526255 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9113bdfd-296f-4426-84f0-8f7d2521bd4e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:40.527037 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9113bdfd-296f-4426-84f0-8f7d2521bd4e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:40.527559 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9113bdfd-296f-4426-84f0-8f7d2521bd4e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:40.528363 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9113bdfd-296f-4426-84f0-8f7d2521bd4e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:40.577360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-13e9c065-6f1c-4010-9819-6f0385bea7d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:40.578459 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-13e9c065-6f1c-4010-9819-6f0385bea7d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:40.585239 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13e9c065-6f1c-4010-9819-6f0385bea7d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:40.585813 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13e9c065-6f1c-4010-9819-6f0385bea7d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:40.586318 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13e9c065-6f1c-4010-9819-6f0385bea7d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:40.586942 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13e9c065-6f1c-4010-9819-6f0385bea7d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:40.587390 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13e9c065-6f1c-4010-9819-6f0385bea7d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:40.587808 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13e9c065-6f1c-4010-9819-6f0385bea7d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:40.686235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9113bdfd-296f-4426-84f0-8f7d2521bd4e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:40.694404 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9113bdfd-296f-4426-84f0-8f7d2521bd4e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.180574 Aug 05 07:14:40.695278 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 44/95] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:40 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:40.725903 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-13e9c065-6f1c-4010-9819-6f0385bea7d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:40.733709 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-13e9c065-6f1c-4010-9819-6f0385bea7d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.160439 Aug 05 07:14:40.734300 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 52/96] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:40 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:40.859359 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-774f976b-c84f-4137-b617-adf5b989a19f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:40.859927 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-774f976b-c84f-4137-b617-adf5b989a19f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:40.869532 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-774f976b-c84f-4137-b617-adf5b989a19f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:40.869993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-774f976b-c84f-4137-b617-adf5b989a19f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:40.870934 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-774f976b-c84f-4137-b617-adf5b989a19f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:40.872204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-774f976b-c84f-4137-b617-adf5b989a19f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:40.872756 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-774f976b-c84f-4137-b617-adf5b989a19f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:40.873208 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-774f976b-c84f-4137-b617-adf5b989a19f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:40.938491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-774f976b-c84f-4137-b617-adf5b989a19f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:40.946414 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-774f976b-c84f-4137-b617-adf5b989a19f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1308 microversion: 2.1 time: 0.090961 Aug 05 07:14:40.946988 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 45/97] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:40 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:41.126495 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4caa4b38-13b0-426d-94a9-24dc2616ed59 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:41.127085 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4caa4b38-13b0-426d-94a9-24dc2616ed59 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:41.134054 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4caa4b38-13b0-426d-94a9-24dc2616ed59 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:41.134545 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4caa4b38-13b0-426d-94a9-24dc2616ed59 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:41.134980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4caa4b38-13b0-426d-94a9-24dc2616ed59 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:41.135692 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4caa4b38-13b0-426d-94a9-24dc2616ed59 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:41.136146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4caa4b38-13b0-426d-94a9-24dc2616ed59 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:41.136572 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4caa4b38-13b0-426d-94a9-24dc2616ed59 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:41.141201 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:41.274408 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4caa4b38-13b0-426d-94a9-24dc2616ed59 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:41.283377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4caa4b38-13b0-426d-94a9-24dc2616ed59 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.160861 Aug 05 07:14:41.284053 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 53/98] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:41 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:41.716024 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b53b4d4e-ec3d-43bc-ba83-65380153f133 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:41.716797 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b53b4d4e-ec3d-43bc-ba83-65380153f133 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:41.724189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b53b4d4e-ec3d-43bc-ba83-65380153f133 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:41.724727 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b53b4d4e-ec3d-43bc-ba83-65380153f133 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:41.725341 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b53b4d4e-ec3d-43bc-ba83-65380153f133 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:41.726120 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b53b4d4e-ec3d-43bc-ba83-65380153f133 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:41.726804 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b53b4d4e-ec3d-43bc-ba83-65380153f133 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:41.727461 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b53b4d4e-ec3d-43bc-ba83-65380153f133 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:41.754544 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9273ec2b-9292-43d0-8c5d-f72a5091d047 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:41.755285 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9273ec2b-9292-43d0-8c5d-f72a5091d047 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:41.761973 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9273ec2b-9292-43d0-8c5d-f72a5091d047 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:41.762561 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9273ec2b-9292-43d0-8c5d-f72a5091d047 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:41.763060 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9273ec2b-9292-43d0-8c5d-f72a5091d047 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:41.763895 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9273ec2b-9292-43d0-8c5d-f72a5091d047 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:41.764408 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9273ec2b-9292-43d0-8c5d-f72a5091d047 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:41.764921 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9273ec2b-9292-43d0-8c5d-f72a5091d047 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:41.861770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b53b4d4e-ec3d-43bc-ba83-65380153f133 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:41.869421 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b53b4d4e-ec3d-43bc-ba83-65380153f133 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.157690 Aug 05 07:14:41.870002 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 46/99] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:41 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:41.897582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9273ec2b-9292-43d0-8c5d-f72a5091d047 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:41.906246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9273ec2b-9292-43d0-8c5d-f72a5091d047 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.155824 Aug 05 07:14:41.906833 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 54/100] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:41 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:41.968677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b6abee8e-a618-4d94-b7d9-d7f039836142 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:41.969498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b6abee8e-a618-4d94-b7d9-d7f039836142 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:41.975808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6abee8e-a618-4d94-b7d9-d7f039836142 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:41.976285 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6abee8e-a618-4d94-b7d9-d7f039836142 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:41.976717 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6abee8e-a618-4d94-b7d9-d7f039836142 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:41.977649 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6abee8e-a618-4d94-b7d9-d7f039836142 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:41.978104 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6abee8e-a618-4d94-b7d9-d7f039836142 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:41.978525 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6abee8e-a618-4d94-b7d9-d7f039836142 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:42.043645 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b6abee8e-a618-4d94-b7d9-d7f039836142 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:42.051680 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b6abee8e-a618-4d94-b7d9-d7f039836142 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1308 microversion: 2.1 time: 0.087990 Aug 05 07:14:42.052257 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 47/101] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:41 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:42.304371 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-fbd51bbb-8d62-4809-80e5-db488eb7b146 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:42.304998 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-fbd51bbb-8d62-4809-80e5-db488eb7b146 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:42.311536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fbd51bbb-8d62-4809-80e5-db488eb7b146 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:42.311997 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fbd51bbb-8d62-4809-80e5-db488eb7b146 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:42.312429 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fbd51bbb-8d62-4809-80e5-db488eb7b146 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:42.313159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fbd51bbb-8d62-4809-80e5-db488eb7b146 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:42.313605 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fbd51bbb-8d62-4809-80e5-db488eb7b146 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:42.314022 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fbd51bbb-8d62-4809-80e5-db488eb7b146 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:42.447601 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-fbd51bbb-8d62-4809-80e5-db488eb7b146 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:42.455570 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-fbd51bbb-8d62-4809-80e5-db488eb7b146 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.154806 Aug 05 07:14:42.456438 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 55/102] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:42 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:42.891532 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a867abe8-f6b3-443d-9cb9-3c24d21466bc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:42.892063 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a867abe8-f6b3-443d-9cb9-3c24d21466bc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:42.898381 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a867abe8-f6b3-443d-9cb9-3c24d21466bc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:42.898860 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a867abe8-f6b3-443d-9cb9-3c24d21466bc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:42.899289 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a867abe8-f6b3-443d-9cb9-3c24d21466bc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:42.899967 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a867abe8-f6b3-443d-9cb9-3c24d21466bc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:42.900415 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a867abe8-f6b3-443d-9cb9-3c24d21466bc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:42.900831 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a867abe8-f6b3-443d-9cb9-3c24d21466bc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:42.927318 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1435ddbf-fd20-4f9f-9f4e-21bbb49c6daa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:42.927964 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1435ddbf-fd20-4f9f-9f4e-21bbb49c6daa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:42.934424 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1435ddbf-fd20-4f9f-9f4e-21bbb49c6daa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:42.934917 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1435ddbf-fd20-4f9f-9f4e-21bbb49c6daa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:42.935383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1435ddbf-fd20-4f9f-9f4e-21bbb49c6daa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:42.936105 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1435ddbf-fd20-4f9f-9f4e-21bbb49c6daa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:42.936557 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1435ddbf-fd20-4f9f-9f4e-21bbb49c6daa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:42.937013 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1435ddbf-fd20-4f9f-9f4e-21bbb49c6daa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:43.043155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a867abe8-f6b3-443d-9cb9-3c24d21466bc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:43.050898 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a867abe8-f6b3-443d-9cb9-3c24d21466bc tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.163948 Aug 05 07:14:43.051483 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 48/103] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:42 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:43.073164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-db06df5c-27b0-4fd6-becd-ee7a8de24119 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:43.073778 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-db06df5c-27b0-4fd6-becd-ee7a8de24119 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:43.080130 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db06df5c-27b0-4fd6-becd-ee7a8de24119 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:43.080618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db06df5c-27b0-4fd6-becd-ee7a8de24119 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:43.080824 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1435ddbf-fd20-4f9f-9f4e-21bbb49c6daa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:43.081083 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db06df5c-27b0-4fd6-becd-ee7a8de24119 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:43.081781 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db06df5c-27b0-4fd6-becd-ee7a8de24119 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:43.082224 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db06df5c-27b0-4fd6-becd-ee7a8de24119 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:43.082647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db06df5c-27b0-4fd6-becd-ee7a8de24119 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:43.091171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1435ddbf-fd20-4f9f-9f4e-21bbb49c6daa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.167611 Aug 05 07:14:43.092057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 56/104] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:42 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:43.145918 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-db06df5c-27b0-4fd6-becd-ee7a8de24119 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:43.153838 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-db06df5c-27b0-4fd6-becd-ee7a8de24119 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1308 microversion: 2.1 time: 0.084608 Aug 05 07:14:43.154404 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 49/105] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:43 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1308 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:43.477008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3b181dcd-0aec-41c4-8589-7066dc8b3a03 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:43.477597 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3b181dcd-0aec-41c4-8589-7066dc8b3a03 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:43.484136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3b181dcd-0aec-41c4-8589-7066dc8b3a03 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:43.484615 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3b181dcd-0aec-41c4-8589-7066dc8b3a03 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:43.485076 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3b181dcd-0aec-41c4-8589-7066dc8b3a03 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:43.485746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3b181dcd-0aec-41c4-8589-7066dc8b3a03 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:43.486186 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3b181dcd-0aec-41c4-8589-7066dc8b3a03 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:43.486599 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3b181dcd-0aec-41c4-8589-7066dc8b3a03 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:43.618375 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3b181dcd-0aec-41c4-8589-7066dc8b3a03 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:43.626268 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3b181dcd-0aec-41c4-8589-7066dc8b3a03 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.153261 Aug 05 07:14:43.626844 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 57/106] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:43 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:44.071924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8020a430-f171-4199-b410-2465ba058099 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:44.072565 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8020a430-f171-4199-b410-2465ba058099 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:44.079100 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8020a430-f171-4199-b410-2465ba058099 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:44.079579 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8020a430-f171-4199-b410-2465ba058099 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:44.080009 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8020a430-f171-4199-b410-2465ba058099 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:44.080693 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8020a430-f171-4199-b410-2465ba058099 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:44.081170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8020a430-f171-4199-b410-2465ba058099 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:44.081592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8020a430-f171-4199-b410-2465ba058099 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:44.111788 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7fd5b4a0-f9c0-41ee-aab6-77999953e6dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:44.112384 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7fd5b4a0-f9c0-41ee-aab6-77999953e6dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:44.118594 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fd5b4a0-f9c0-41ee-aab6-77999953e6dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:44.119075 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fd5b4a0-f9c0-41ee-aab6-77999953e6dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:44.119499 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fd5b4a0-f9c0-41ee-aab6-77999953e6dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:44.120179 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fd5b4a0-f9c0-41ee-aab6-77999953e6dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:44.120715 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fd5b4a0-f9c0-41ee-aab6-77999953e6dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:44.121060 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fd5b4a0-f9c0-41ee-aab6-77999953e6dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:44.223859 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8020a430-f171-4199-b410-2465ba058099 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:44.231438 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8020a430-f171-4199-b410-2465ba058099 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.163434 Aug 05 07:14:44.232096 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 50/107] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:44 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:44.236722 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4a7782e2-1971-414c-825b-995ca4164135 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:44.237291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4a7782e2-1971-414c-825b-995ca4164135 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:44.243400 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a7782e2-1971-414c-825b-995ca4164135 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:44.243889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a7782e2-1971-414c-825b-995ca4164135 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:44.244323 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a7782e2-1971-414c-825b-995ca4164135 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:44.245128 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a7782e2-1971-414c-825b-995ca4164135 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:44.245597 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a7782e2-1971-414c-825b-995ca4164135 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:44.246018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a7782e2-1971-414c-825b-995ca4164135 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:44.259661 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7fd5b4a0-f9c0-41ee-aab6-77999953e6dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:44.268084 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7fd5b4a0-f9c0-41ee-aab6-77999953e6dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.160028 Aug 05 07:14:44.269963 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 58/108] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:44 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:44.317450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4a7782e2-1971-414c-825b-995ca4164135 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:44.325382 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4a7782e2-1971-414c-825b-995ca4164135 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1308 microversion: 2.1 time: 0.092270 Aug 05 07:14:44.326017 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 51/109] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:44 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:44.647159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-50d50435-15d7-42e5-8a38-88befb3086a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:44.647734 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-50d50435-15d7-42e5-8a38-88befb3086a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:44.654688 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-50d50435-15d7-42e5-8a38-88befb3086a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:44.655167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-50d50435-15d7-42e5-8a38-88befb3086a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:44.655602 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-50d50435-15d7-42e5-8a38-88befb3086a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:44.656283 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-50d50435-15d7-42e5-8a38-88befb3086a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:44.656728 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-50d50435-15d7-42e5-8a38-88befb3086a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:44.657185 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-50d50435-15d7-42e5-8a38-88befb3086a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:44.790319 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-50d50435-15d7-42e5-8a38-88befb3086a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:44.799031 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-50d50435-15d7-42e5-8a38-88befb3086a1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.155676 Aug 05 07:14:44.799624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 59/110] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:44 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:45.252197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-be3a44ee-eca2-4d40-b7ff-78c77d8abb10 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:45.253038 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-be3a44ee-eca2-4d40-b7ff-78c77d8abb10 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:45.259850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be3a44ee-eca2-4d40-b7ff-78c77d8abb10 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:45.260419 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be3a44ee-eca2-4d40-b7ff-78c77d8abb10 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:45.260855 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be3a44ee-eca2-4d40-b7ff-78c77d8abb10 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:45.261584 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be3a44ee-eca2-4d40-b7ff-78c77d8abb10 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:45.262030 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be3a44ee-eca2-4d40-b7ff-78c77d8abb10 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:45.262479 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be3a44ee-eca2-4d40-b7ff-78c77d8abb10 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:45.290434 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-84f2832a-cb31-43b8-9762-99485a03f59c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:45.291051 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-84f2832a-cb31-43b8-9762-99485a03f59c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:45.299099 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-84f2832a-cb31-43b8-9762-99485a03f59c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:45.299895 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-84f2832a-cb31-43b8-9762-99485a03f59c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:45.300484 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-84f2832a-cb31-43b8-9762-99485a03f59c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:45.301211 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-84f2832a-cb31-43b8-9762-99485a03f59c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:45.301864 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-84f2832a-cb31-43b8-9762-99485a03f59c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:45.302353 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-84f2832a-cb31-43b8-9762-99485a03f59c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:45.479504 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-be3a44ee-eca2-4d40-b7ff-78c77d8abb10 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:45.489500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-be3a44ee-eca2-4d40-b7ff-78c77d8abb10 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.241435 Aug 05 07:14:45.491063 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 52/111] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:45 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:45.496319 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f66c383f-9d60-4966-b9d1-3665b7770541 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:45.497922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f66c383f-9d60-4966-b9d1-3665b7770541 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:45.505032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f66c383f-9d60-4966-b9d1-3665b7770541 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:45.506064 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f66c383f-9d60-4966-b9d1-3665b7770541 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:45.506725 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f66c383f-9d60-4966-b9d1-3665b7770541 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:45.507668 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f66c383f-9d60-4966-b9d1-3665b7770541 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:45.508374 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f66c383f-9d60-4966-b9d1-3665b7770541 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:45.509042 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f66c383f-9d60-4966-b9d1-3665b7770541 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:45.524228 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-84f2832a-cb31-43b8-9762-99485a03f59c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:45.538888 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-84f2832a-cb31-43b8-9762-99485a03f59c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.252043 Aug 05 07:14:45.540223 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 60/112] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:45 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:45.599003 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f66c383f-9d60-4966-b9d1-3665b7770541 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:45.615343 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f66c383f-9d60-4966-b9d1-3665b7770541 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1308 microversion: 2.1 time: 0.117826 Aug 05 07:14:45.615343 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 53/113] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:45 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:45.820678 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9d06b51f-4f51-46c0-9eb1-507267a0e7f7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:45.821306 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9d06b51f-4f51-46c0-9eb1-507267a0e7f7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:45.827714 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9d06b51f-4f51-46c0-9eb1-507267a0e7f7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:45.828185 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9d06b51f-4f51-46c0-9eb1-507267a0e7f7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:45.828612 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9d06b51f-4f51-46c0-9eb1-507267a0e7f7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:45.829323 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9d06b51f-4f51-46c0-9eb1-507267a0e7f7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:45.829782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9d06b51f-4f51-46c0-9eb1-507267a0e7f7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:45.830173 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9d06b51f-4f51-46c0-9eb1-507267a0e7f7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:45.975989 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9d06b51f-4f51-46c0-9eb1-507267a0e7f7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:45.983673 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9d06b51f-4f51-46c0-9eb1-507267a0e7f7 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.167587 Aug 05 07:14:45.984239 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 61/114] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:45 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:46.514754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-26db25db-5c87-433b-972b-a55ba95bec8a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:46.515401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-26db25db-5c87-433b-972b-a55ba95bec8a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:46.522233 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26db25db-5c87-433b-972b-a55ba95bec8a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:46.522722 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26db25db-5c87-433b-972b-a55ba95bec8a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:46.523166 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26db25db-5c87-433b-972b-a55ba95bec8a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:46.523867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26db25db-5c87-433b-972b-a55ba95bec8a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:46.524296 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26db25db-5c87-433b-972b-a55ba95bec8a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:46.524712 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26db25db-5c87-433b-972b-a55ba95bec8a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:46.559887 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e2358f1f-a913-4848-86a8-984f40ce3d2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:46.560521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e2358f1f-a913-4848-86a8-984f40ce3d2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:46.566811 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e2358f1f-a913-4848-86a8-984f40ce3d2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:46.567292 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e2358f1f-a913-4848-86a8-984f40ce3d2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:46.567715 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e2358f1f-a913-4848-86a8-984f40ce3d2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:46.568399 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e2358f1f-a913-4848-86a8-984f40ce3d2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:46.568837 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e2358f1f-a913-4848-86a8-984f40ce3d2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:46.569279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e2358f1f-a913-4848-86a8-984f40ce3d2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:46.672951 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-26db25db-5c87-433b-972b-a55ba95bec8a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:46.680738 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-26db25db-5c87-433b-972b-a55ba95bec8a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.170796 Aug 05 07:14:46.692919 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 54/115] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:46 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:46.692919 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f26d3dfb-a9b7-4260-b585-daefd8ae48b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:46.692919 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f26d3dfb-a9b7-4260-b585-daefd8ae48b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:46.692919 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f26d3dfb-a9b7-4260-b585-daefd8ae48b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:46.693345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f26d3dfb-a9b7-4260-b585-daefd8ae48b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:46.693483 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f26d3dfb-a9b7-4260-b585-daefd8ae48b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:46.694169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f26d3dfb-a9b7-4260-b585-daefd8ae48b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:46.694764 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f26d3dfb-a9b7-4260-b585-daefd8ae48b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:46.695186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f26d3dfb-a9b7-4260-b585-daefd8ae48b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:46.701522 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e2358f1f-a913-4848-86a8-984f40ce3d2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:46.709543 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e2358f1f-a913-4848-86a8-984f40ce3d2d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.153477 Aug 05 07:14:46.710118 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 62/116] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:46 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:46.757353 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f26d3dfb-a9b7-4260-b585-daefd8ae48b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:46.765152 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f26d3dfb-a9b7-4260-b585-daefd8ae48b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1308 microversion: 2.1 time: 0.082730 Aug 05 07:14:46.765661 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 55/117] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:46 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1308 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:47.005648 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d30989b4-ccba-41d8-82d1-70db4c8997d3 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:47.006282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d30989b4-ccba-41d8-82d1-70db4c8997d3 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:47.012929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d30989b4-ccba-41d8-82d1-70db4c8997d3 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:47.013594 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d30989b4-ccba-41d8-82d1-70db4c8997d3 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:47.014026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d30989b4-ccba-41d8-82d1-70db4c8997d3 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:47.014717 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d30989b4-ccba-41d8-82d1-70db4c8997d3 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:47.015226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d30989b4-ccba-41d8-82d1-70db4c8997d3 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:47.015579 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d30989b4-ccba-41d8-82d1-70db4c8997d3 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:47.155377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d30989b4-ccba-41d8-82d1-70db4c8997d3 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:47.163019 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d30989b4-ccba-41d8-82d1-70db4c8997d3 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.161440 Aug 05 07:14:47.163594 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 63/118] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:47 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:47.702622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-40629770-8148-492a-bf7a-06c360ddb239 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:47.703201 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-40629770-8148-492a-bf7a-06c360ddb239 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:47.709900 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40629770-8148-492a-bf7a-06c360ddb239 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:47.710371 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40629770-8148-492a-bf7a-06c360ddb239 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:47.710770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40629770-8148-492a-bf7a-06c360ddb239 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:47.711482 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40629770-8148-492a-bf7a-06c360ddb239 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:47.711933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40629770-8148-492a-bf7a-06c360ddb239 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:47.712352 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40629770-8148-492a-bf7a-06c360ddb239 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:47.730118 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-93172804-4af3-4c52-aa6b-7a7ade22d7d7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:47.730740 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-93172804-4af3-4c52-aa6b-7a7ade22d7d7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:47.737087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-93172804-4af3-4c52-aa6b-7a7ade22d7d7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:47.737580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-93172804-4af3-4c52-aa6b-7a7ade22d7d7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:47.738014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-93172804-4af3-4c52-aa6b-7a7ade22d7d7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:47.738714 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-93172804-4af3-4c52-aa6b-7a7ade22d7d7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:47.739166 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-93172804-4af3-4c52-aa6b-7a7ade22d7d7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:47.739588 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-93172804-4af3-4c52-aa6b-7a7ade22d7d7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:47.852145 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-40629770-8148-492a-bf7a-06c360ddb239 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:47.861399 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-40629770-8148-492a-bf7a-06c360ddb239 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.162789 Aug 05 07:14:47.861991 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 56/119] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:47 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:47.866995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4141c9be-dcbb-4d68-973f-fdc22d1150b9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:47.867603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4141c9be-dcbb-4d68-973f-fdc22d1150b9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:47.873807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4141c9be-dcbb-4d68-973f-fdc22d1150b9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:47.874297 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4141c9be-dcbb-4d68-973f-fdc22d1150b9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:47.874756 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4141c9be-dcbb-4d68-973f-fdc22d1150b9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:47.875450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4141c9be-dcbb-4d68-973f-fdc22d1150b9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:47.875906 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4141c9be-dcbb-4d68-973f-fdc22d1150b9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:47.876320 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4141c9be-dcbb-4d68-973f-fdc22d1150b9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:47.910871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-93172804-4af3-4c52-aa6b-7a7ade22d7d7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:47.925446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-93172804-4af3-4c52-aa6b-7a7ade22d7d7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.199154 Aug 05 07:14:47.926053 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 64/120] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:47 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:47.940274 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4141c9be-dcbb-4d68-973f-fdc22d1150b9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:47.948011 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4141c9be-dcbb-4d68-973f-fdc22d1150b9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1308 microversion: 2.1 time: 0.085096 Aug 05 07:14:47.948568 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 57/121] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:47 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1308 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:48.184157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2fa1cde1-06f6-4964-8e95-aa523bf11d84 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:48.184800 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2fa1cde1-06f6-4964-8e95-aa523bf11d84 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:48.191929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2fa1cde1-06f6-4964-8e95-aa523bf11d84 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:48.192412 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2fa1cde1-06f6-4964-8e95-aa523bf11d84 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:48.192850 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2fa1cde1-06f6-4964-8e95-aa523bf11d84 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:48.193573 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2fa1cde1-06f6-4964-8e95-aa523bf11d84 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:48.194019 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2fa1cde1-06f6-4964-8e95-aa523bf11d84 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:48.194435 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2fa1cde1-06f6-4964-8e95-aa523bf11d84 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:48.330252 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2fa1cde1-06f6-4964-8e95-aa523bf11d84 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:48.338072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2fa1cde1-06f6-4964-8e95-aa523bf11d84 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.157869 Aug 05 07:14:48.338678 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 65/122] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:48 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:48.881907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-474a1fd4-d961-4844-bc7d-0adbcf92550e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:48.882446 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-474a1fd4-d961-4844-bc7d-0adbcf92550e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:48.889109 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-474a1fd4-d961-4844-bc7d-0adbcf92550e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:48.889595 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-474a1fd4-d961-4844-bc7d-0adbcf92550e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:48.890031 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-474a1fd4-d961-4844-bc7d-0adbcf92550e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:48.890717 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-474a1fd4-d961-4844-bc7d-0adbcf92550e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:48.891172 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-474a1fd4-d961-4844-bc7d-0adbcf92550e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:48.891592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-474a1fd4-d961-4844-bc7d-0adbcf92550e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:48.946603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3743f421-2de8-44fb-903c-c13362a69f70 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:48.947214 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3743f421-2de8-44fb-903c-c13362a69f70 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:48.949248 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:48.954967 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3743f421-2de8-44fb-903c-c13362a69f70 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:48.955465 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3743f421-2de8-44fb-903c-c13362a69f70 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:48.955861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3743f421-2de8-44fb-903c-c13362a69f70 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:48.956546 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3743f421-2de8-44fb-903c-c13362a69f70 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:48.957381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3743f421-2de8-44fb-903c-c13362a69f70 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:48.958005 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3743f421-2de8-44fb-903c-c13362a69f70 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:49.039538 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-474a1fd4-d961-4844-bc7d-0adbcf92550e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:49.047861 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-474a1fd4-d961-4844-bc7d-0adbcf92550e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.169884 Aug 05 07:14:49.048561 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 58/123] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:48 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:49.053985 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-91c9ecfd-2294-4ba6-9ee5-095cca80765b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:49.054670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-91c9ecfd-2294-4ba6-9ee5-095cca80765b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:49.061385 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-91c9ecfd-2294-4ba6-9ee5-095cca80765b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:49.062006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-91c9ecfd-2294-4ba6-9ee5-095cca80765b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:49.062473 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-91c9ecfd-2294-4ba6-9ee5-095cca80765b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:49.063647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-91c9ecfd-2294-4ba6-9ee5-095cca80765b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:49.065646 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-91c9ecfd-2294-4ba6-9ee5-095cca80765b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:49.066485 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-91c9ecfd-2294-4ba6-9ee5-095cca80765b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:49.085551 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:49.112028 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3743f421-2de8-44fb-903c-c13362a69f70 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:49.119698 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3743f421-2de8-44fb-903c-c13362a69f70 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.177301 Aug 05 07:14:49.120278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 66/124] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:48 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:49.139287 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-91c9ecfd-2294-4ba6-9ee5-095cca80765b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:49.147089 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-91c9ecfd-2294-4ba6-9ee5-095cca80765b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1308 microversion: 2.1 time: 0.097121 Aug 05 07:14:49.147663 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 59/125] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:49 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:49.359373 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-084e4fc4-2b20-49f5-a8f1-e9f6867254e1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:49.359977 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-084e4fc4-2b20-49f5-a8f1-e9f6867254e1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:49.366711 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-084e4fc4-2b20-49f5-a8f1-e9f6867254e1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:49.367221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-084e4fc4-2b20-49f5-a8f1-e9f6867254e1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:49.367607 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-084e4fc4-2b20-49f5-a8f1-e9f6867254e1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:49.368312 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-084e4fc4-2b20-49f5-a8f1-e9f6867254e1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:49.368706 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-084e4fc4-2b20-49f5-a8f1-e9f6867254e1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:49.369184 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-084e4fc4-2b20-49f5-a8f1-e9f6867254e1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:49.502133 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-084e4fc4-2b20-49f5-a8f1-e9f6867254e1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:49.510043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-084e4fc4-2b20-49f5-a8f1-e9f6867254e1 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.154663 Aug 05 07:14:49.510606 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 67/126] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:49 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:50.069870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-846f4778-9f97-4bfc-a899-979037d4e933 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:50.071534 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-846f4778-9f97-4bfc-a899-979037d4e933 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:50.087775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-846f4778-9f97-4bfc-a899-979037d4e933 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:50.088229 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-846f4778-9f97-4bfc-a899-979037d4e933 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:50.088651 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-846f4778-9f97-4bfc-a899-979037d4e933 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:50.089431 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-846f4778-9f97-4bfc-a899-979037d4e933 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:50.089905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-846f4778-9f97-4bfc-a899-979037d4e933 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:50.090293 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-846f4778-9f97-4bfc-a899-979037d4e933 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:50.139950 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6c946b60-c983-482e-95b3-924e0c12872d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:50.140558 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-6c946b60-c983-482e-95b3-924e0c12872d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:50.147301 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6c946b60-c983-482e-95b3-924e0c12872d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:50.147780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6c946b60-c983-482e-95b3-924e0c12872d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:50.148232 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6c946b60-c983-482e-95b3-924e0c12872d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:50.148954 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6c946b60-c983-482e-95b3-924e0c12872d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:50.149410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6c946b60-c983-482e-95b3-924e0c12872d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:50.149814 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6c946b60-c983-482e-95b3-924e0c12872d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:50.294420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-6c946b60-c983-482e-95b3-924e0c12872d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:50.302656 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-6c946b60-c983-482e-95b3-924e0c12872d tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.166718 Aug 05 07:14:50.310140 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 68/127] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:50 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:50.316564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-999c483f-e2e8-424d-bbe9-230dd166d54d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:50.317325 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-999c483f-e2e8-424d-bbe9-230dd166d54d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:50.325460 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-999c483f-e2e8-424d-bbe9-230dd166d54d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:50.326425 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-999c483f-e2e8-424d-bbe9-230dd166d54d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:50.327124 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-999c483f-e2e8-424d-bbe9-230dd166d54d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:50.328005 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-999c483f-e2e8-424d-bbe9-230dd166d54d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:50.328540 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-999c483f-e2e8-424d-bbe9-230dd166d54d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:50.328990 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-999c483f-e2e8-424d-bbe9-230dd166d54d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:50.392606 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-999c483f-e2e8-424d-bbe9-230dd166d54d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:50.396288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:50.401599 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-999c483f-e2e8-424d-bbe9-230dd166d54d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1296 microversion: 2.1 time: 0.097247 Aug 05 07:14:50.402179 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 69/128] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:50 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:50.406981 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-846f4778-9f97-4bfc-a899-979037d4e933 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:50.414836 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-846f4778-9f97-4bfc-a899-979037d4e933 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.350429 Aug 05 07:14:50.415490 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 60/129] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:50 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:50.531026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b85268b5-038c-4fac-a33b-5f9a6dbd0656 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:50.531637 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b85268b5-038c-4fac-a33b-5f9a6dbd0656 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:50.537763 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b85268b5-038c-4fac-a33b-5f9a6dbd0656 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:50.538239 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b85268b5-038c-4fac-a33b-5f9a6dbd0656 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:50.538668 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b85268b5-038c-4fac-a33b-5f9a6dbd0656 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:50.539366 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b85268b5-038c-4fac-a33b-5f9a6dbd0656 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:50.539809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b85268b5-038c-4fac-a33b-5f9a6dbd0656 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:50.540226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b85268b5-038c-4fac-a33b-5f9a6dbd0656 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:50.675975 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b85268b5-038c-4fac-a33b-5f9a6dbd0656 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:50.684257 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b85268b5-038c-4fac-a33b-5f9a6dbd0656 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.157605 Aug 05 07:14:50.684843 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 70/130] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:50 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:51.325053 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-04ad72e6-4db7-4e6a-8792-ed4a7a156811 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:51.326314 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-04ad72e6-4db7-4e6a-8792-ed4a7a156811 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:51.333588 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-04ad72e6-4db7-4e6a-8792-ed4a7a156811 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:51.334130 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-04ad72e6-4db7-4e6a-8792-ed4a7a156811 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:51.334743 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-04ad72e6-4db7-4e6a-8792-ed4a7a156811 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:51.335454 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-04ad72e6-4db7-4e6a-8792-ed4a7a156811 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:51.336075 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-04ad72e6-4db7-4e6a-8792-ed4a7a156811 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:51.336811 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-04ad72e6-4db7-4e6a-8792-ed4a7a156811 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:51.428704 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-045bea93-ae19-4fb0-957c-2b9da524f32a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:51.432143 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-045bea93-ae19-4fb0-957c-2b9da524f32a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:51.439165 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-045bea93-ae19-4fb0-957c-2b9da524f32a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:51.440006 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-045bea93-ae19-4fb0-957c-2b9da524f32a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:51.441089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-045bea93-ae19-4fb0-957c-2b9da524f32a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:51.442355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-045bea93-ae19-4fb0-957c-2b9da524f32a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:51.444690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-045bea93-ae19-4fb0-957c-2b9da524f32a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:51.445747 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-045bea93-ae19-4fb0-957c-2b9da524f32a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:51.531202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-045bea93-ae19-4fb0-957c-2b9da524f32a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:51.541965 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-045bea93-ae19-4fb0-957c-2b9da524f32a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1296 microversion: 2.1 time: 0.120206 Aug 05 07:14:51.542560 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 71/131] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:51 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1296 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:51.547495 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-15a49f3c-e223-495a-9838-361ddd3094c0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:51.548323 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-15a49f3c-e223-495a-9838-361ddd3094c0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:51.555217 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15a49f3c-e223-495a-9838-361ddd3094c0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:51.556019 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15a49f3c-e223-495a-9838-361ddd3094c0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:51.556615 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15a49f3c-e223-495a-9838-361ddd3094c0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:51.557534 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15a49f3c-e223-495a-9838-361ddd3094c0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:51.558127 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15a49f3c-e223-495a-9838-361ddd3094c0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:51.558552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15a49f3c-e223-495a-9838-361ddd3094c0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:51.587050 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-04ad72e6-4db7-4e6a-8792-ed4a7a156811 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:51.596598 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-04ad72e6-4db7-4e6a-8792-ed4a7a156811 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.275657 Aug 05 07:14:51.610078 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 61/132] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:51 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:51.708407 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fffa0e28-60bd-45cc-a8b6-d54ba7625717 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:51.709252 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fffa0e28-60bd-45cc-a8b6-d54ba7625717 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:51.710496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-15a49f3c-e223-495a-9838-361ddd3094c0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:51.719498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fffa0e28-60bd-45cc-a8b6-d54ba7625717 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:51.720349 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-15a49f3c-e223-495a-9838-361ddd3094c0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.176272 Aug 05 07:14:51.720469 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fffa0e28-60bd-45cc-a8b6-d54ba7625717 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:51.721180 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fffa0e28-60bd-45cc-a8b6-d54ba7625717 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:51.721580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 72/133] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:51 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:51.733953 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fffa0e28-60bd-45cc-a8b6-d54ba7625717 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:51.734603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fffa0e28-60bd-45cc-a8b6-d54ba7625717 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:51.743155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fffa0e28-60bd-45cc-a8b6-d54ba7625717 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:51.998571 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fffa0e28-60bd-45cc-a8b6-d54ba7625717 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:52.023113 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fffa0e28-60bd-45cc-a8b6-d54ba7625717 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.321574 Aug 05 07:14:52.023727 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 62/134] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:51 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:52.563202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6c347a72-9dec-40a0-a930-07d6a3072be2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:52.563976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-6c347a72-9dec-40a0-a930-07d6a3072be2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:52.572677 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6c347a72-9dec-40a0-a930-07d6a3072be2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:52.573322 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6c347a72-9dec-40a0-a930-07d6a3072be2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:52.573886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6c347a72-9dec-40a0-a930-07d6a3072be2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:52.574803 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6c347a72-9dec-40a0-a930-07d6a3072be2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:52.575344 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6c347a72-9dec-40a0-a930-07d6a3072be2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:52.575881 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6c347a72-9dec-40a0-a930-07d6a3072be2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:52.617387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7645deed-6e42-4dd9-9478-d31cef62ddfb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:52.618090 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7645deed-6e42-4dd9-9478-d31cef62ddfb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:52.625056 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7645deed-6e42-4dd9-9478-d31cef62ddfb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:52.625569 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7645deed-6e42-4dd9-9478-d31cef62ddfb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:52.626012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7645deed-6e42-4dd9-9478-d31cef62ddfb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:52.626722 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7645deed-6e42-4dd9-9478-d31cef62ddfb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:52.627193 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7645deed-6e42-4dd9-9478-d31cef62ddfb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:52.627643 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7645deed-6e42-4dd9-9478-d31cef62ddfb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:52.739427 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-6c347a72-9dec-40a0-a930-07d6a3072be2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:52.747194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-6c347a72-9dec-40a0-a930-07d6a3072be2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.187980 Aug 05 07:14:52.748365 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 73/135] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:52 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:52.754714 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-dc9cdbf0-7581-4f6d-9537-7008bc7aa98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:52.755510 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-dc9cdbf0-7581-4f6d-9537-7008bc7aa98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:52.762188 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc9cdbf0-7581-4f6d-9537-7008bc7aa98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:52.762798 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc9cdbf0-7581-4f6d-9537-7008bc7aa98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:52.763314 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc9cdbf0-7581-4f6d-9537-7008bc7aa98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:52.764264 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc9cdbf0-7581-4f6d-9537-7008bc7aa98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:52.764739 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc9cdbf0-7581-4f6d-9537-7008bc7aa98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:52.765175 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc9cdbf0-7581-4f6d-9537-7008bc7aa98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:52.796426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7645deed-6e42-4dd9-9478-d31cef62ddfb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:52.804356 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7645deed-6e42-4dd9-9478-d31cef62ddfb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.191107 Aug 05 07:14:52.805064 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 63/136] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:52 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:14:52.902515 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-dc9cdbf0-7581-4f6d-9537-7008bc7aa98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:52.911667 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-dc9cdbf0-7581-4f6d-9537-7008bc7aa98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.162046 Aug 05 07:14:52.912242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 74/137] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:52 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:53.044711 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e6a863f5-92da-4e2b-baa0-11eb8d53ebbe tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:53.045355 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e6a863f5-92da-4e2b-baa0-11eb8d53ebbe tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:53.051536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6a863f5-92da-4e2b-baa0-11eb8d53ebbe tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:53.052015 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6a863f5-92da-4e2b-baa0-11eb8d53ebbe tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:53.052440 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6a863f5-92da-4e2b-baa0-11eb8d53ebbe tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:53.053153 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6a863f5-92da-4e2b-baa0-11eb8d53ebbe tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:53.053598 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6a863f5-92da-4e2b-baa0-11eb8d53ebbe tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:53.054012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6a863f5-92da-4e2b-baa0-11eb8d53ebbe tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:53.305587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e6a863f5-92da-4e2b-baa0-11eb8d53ebbe tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:53.318853 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e6a863f5-92da-4e2b-baa0-11eb8d53ebbe tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.278210 Aug 05 07:14:53.333736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 64/138] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:53 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:53.666990 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-b122efa3-4a20-423e-8d1f-64c65f4ae942 req-a19c85d2-e666-4a29-a585-40984e5ed90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f899e07a-87f6-4228-9dc1-c92ec3eed017", "name": "network-vif-plugged", "status": "completed", "tag": "ca9499bf-08de-46eb-b235-f09c2fccac1d"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:14:53.679322 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-b122efa3-4a20-423e-8d1f-64c65f4ae942 req-a19c85d2-e666-4a29-a585-40984e5ed90f service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:53.680074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-b122efa3-4a20-423e-8d1f-64c65f4ae942 req-a19c85d2-e666-4a29-a585-40984e5ed90f service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:53.681009 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-b122efa3-4a20-423e-8d1f-64c65f4ae942 req-a19c85d2-e666-4a29-a585-40984e5ed90f service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:53.701843 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-b122efa3-4a20-423e-8d1f-64c65f4ae942 req-a19c85d2-e666-4a29-a585-40984e5ed90f service nova] Creating event network-vif-plugged:ca9499bf-08de-46eb-b235-f09c2fccac1d for instance f899e07a-87f6-4228-9dc1-c92ec3eed017 on hv-cinder-85200 Aug 05 07:14:53.710041 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-b122efa3-4a20-423e-8d1f-64c65f4ae942 req-a19c85d2-e666-4a29-a585-40984e5ed90f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142814 Aug 05 07:14:53.710041 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 75/139] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:14:53.768992 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ac073c99-5dec-4de4-b23f-468f63be0820 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:53.770245 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ac073c99-5dec-4de4-b23f-468f63be0820 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:53.777175 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac073c99-5dec-4de4-b23f-468f63be0820 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:53.778008 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac073c99-5dec-4de4-b23f-468f63be0820 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:53.778440 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac073c99-5dec-4de4-b23f-468f63be0820 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:53.779166 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac073c99-5dec-4de4-b23f-468f63be0820 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:53.779609 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac073c99-5dec-4de4-b23f-468f63be0820 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:53.780023 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac073c99-5dec-4de4-b23f-468f63be0820 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:53.825464 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d9d3b929-1fc8-41ca-a252-e27ff97820f2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:53.825783 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d9d3b929-1fc8-41ca-a252-e27ff97820f2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:53.832785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9d3b929-1fc8-41ca-a252-e27ff97820f2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:53.833308 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9d3b929-1fc8-41ca-a252-e27ff97820f2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:53.833745 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9d3b929-1fc8-41ca-a252-e27ff97820f2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:53.834442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9d3b929-1fc8-41ca-a252-e27ff97820f2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:53.834899 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9d3b929-1fc8-41ca-a252-e27ff97820f2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:53.835314 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9d3b929-1fc8-41ca-a252-e27ff97820f2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:53.920204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ac073c99-5dec-4de4-b23f-468f63be0820 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:53.929175 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ac073c99-5dec-4de4-b23f-468f63be0820 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.164235 Aug 05 07:14:53.929762 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 65/140] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:53 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:53.934689 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a54a7a31-9def-4926-858d-6f81e1495af3 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:53.935795 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a54a7a31-9def-4926-858d-6f81e1495af3 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:53.942489 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a54a7a31-9def-4926-858d-6f81e1495af3 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:53.943197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a54a7a31-9def-4926-858d-6f81e1495af3 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:53.943838 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a54a7a31-9def-4926-858d-6f81e1495af3 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:53.944795 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a54a7a31-9def-4926-858d-6f81e1495af3 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:53.945493 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a54a7a31-9def-4926-858d-6f81e1495af3 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:53.946123 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a54a7a31-9def-4926-858d-6f81e1495af3 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:53.984283 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d9d3b929-1fc8-41ca-a252-e27ff97820f2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:53.994282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d9d3b929-1fc8-41ca-a252-e27ff97820f2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.173651 Aug 05 07:14:53.994929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 76/141] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:53 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:54.202077 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a54a7a31-9def-4926-858d-6f81e1495af3 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:54.211610 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a54a7a31-9def-4926-858d-6f81e1495af3 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.280629 Aug 05 07:14:54.212189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 66/142] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:53 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:54.340441 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-df885b95-dd76-463c-aaff-44bb023b9842 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:54.341094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-df885b95-dd76-463c-aaff-44bb023b9842 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:54.350196 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-df885b95-dd76-463c-aaff-44bb023b9842 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:54.351800 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-df885b95-dd76-463c-aaff-44bb023b9842 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:54.352556 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-df885b95-dd76-463c-aaff-44bb023b9842 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:54.353369 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-df885b95-dd76-463c-aaff-44bb023b9842 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:54.353881 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-df885b95-dd76-463c-aaff-44bb023b9842 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:54.354393 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-df885b95-dd76-463c-aaff-44bb023b9842 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:54.534398 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-df885b95-dd76-463c-aaff-44bb023b9842 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:54.542805 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-df885b95-dd76-463c-aaff-44bb023b9842 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.206182 Aug 05 07:14:54.545305 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 77/143] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:54 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:54.896027 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-10ba7949-5948-4bf7-b102-34cac2cd2c2e req-06d0008a-79c1-43a8-8d14-773b9e3ea4ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acf59ded-e598-4ac7-ba2e-9a3c2210d007", "tag": "ede42d65-04d0-40ad-8a04-8c635128bf7f"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:14:54.906324 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-10ba7949-5948-4bf7-b102-34cac2cd2c2e req-06d0008a-79c1-43a8-8d14-773b9e3ea4ab service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:54.906773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-10ba7949-5948-4bf7-b102-34cac2cd2c2e req-06d0008a-79c1-43a8-8d14-773b9e3ea4ab service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:54.907210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-10ba7949-5948-4bf7-b102-34cac2cd2c2e req-06d0008a-79c1-43a8-8d14-773b9e3ea4ab service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:54.919047 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-10ba7949-5948-4bf7-b102-34cac2cd2c2e req-06d0008a-79c1-43a8-8d14-773b9e3ea4ab service nova] Creating event network-changed:ede42d65-04d0-40ad-8a04-8c635128bf7f for instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 on hv-cinder-85200 Aug 05 07:14:54.925224 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-10ba7949-5948-4bf7-b102-34cac2cd2c2e req-06d0008a-79c1-43a8-8d14-773b9e3ea4ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036042 Aug 05 07:14:54.926517 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 67/144] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:14:54.949451 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c5127092-2c0e-4fb6-a49a-d62ab2fcc019 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:54.950060 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c5127092-2c0e-4fb6-a49a-d62ab2fcc019 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:54.956483 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c5127092-2c0e-4fb6-a49a-d62ab2fcc019 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:54.957001 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c5127092-2c0e-4fb6-a49a-d62ab2fcc019 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:54.957429 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c5127092-2c0e-4fb6-a49a-d62ab2fcc019 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:54.958096 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c5127092-2c0e-4fb6-a49a-d62ab2fcc019 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:54.958560 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c5127092-2c0e-4fb6-a49a-d62ab2fcc019 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:54.958977 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c5127092-2c0e-4fb6-a49a-d62ab2fcc019 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:55.016148 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-59b427ab-375d-4a9e-8f0b-9f4839ce0206 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:55.016821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-59b427ab-375d-4a9e-8f0b-9f4839ce0206 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:55.024329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59b427ab-375d-4a9e-8f0b-9f4839ce0206 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:55.024809 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59b427ab-375d-4a9e-8f0b-9f4839ce0206 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:55.025279 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59b427ab-375d-4a9e-8f0b-9f4839ce0206 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:55.025969 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59b427ab-375d-4a9e-8f0b-9f4839ce0206 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:55.026571 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59b427ab-375d-4a9e-8f0b-9f4839ce0206 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:55.027174 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59b427ab-375d-4a9e-8f0b-9f4839ce0206 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:55.111610 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c5127092-2c0e-4fb6-a49a-d62ab2fcc019 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:55.120332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c5127092-2c0e-4fb6-a49a-d62ab2fcc019 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.174486 Aug 05 07:14:55.121128 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 78/145] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:54 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:55.189679 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-59b427ab-375d-4a9e-8f0b-9f4839ce0206 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:55.198912 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-59b427ab-375d-4a9e-8f0b-9f4839ce0206 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.187155 Aug 05 07:14:55.199405 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 68/146] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:55 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:55.233686 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-48607eff-97d2-4a99-8915-628aa1fa8670 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:55.234347 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-48607eff-97d2-4a99-8915-628aa1fa8670 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:55.245499 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48607eff-97d2-4a99-8915-628aa1fa8670 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:55.246002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48607eff-97d2-4a99-8915-628aa1fa8670 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:55.246416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48607eff-97d2-4a99-8915-628aa1fa8670 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:55.247256 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48607eff-97d2-4a99-8915-628aa1fa8670 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:55.247586 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48607eff-97d2-4a99-8915-628aa1fa8670 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:55.248196 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48607eff-97d2-4a99-8915-628aa1fa8670 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:55.383198 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-48607eff-97d2-4a99-8915-628aa1fa8670 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:55.392967 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-48607eff-97d2-4a99-8915-628aa1fa8670 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.163407 Aug 05 07:14:55.393770 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 79/147] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:55 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:55.563288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-48f817e2-b610-4488-b15a-90ab52e3b12f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:55.564084 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-48f817e2-b610-4488-b15a-90ab52e3b12f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:55.570495 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48f817e2-b610-4488-b15a-90ab52e3b12f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:55.571160 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48f817e2-b610-4488-b15a-90ab52e3b12f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:55.571840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48f817e2-b610-4488-b15a-90ab52e3b12f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:55.572525 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48f817e2-b610-4488-b15a-90ab52e3b12f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:55.573002 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48f817e2-b610-4488-b15a-90ab52e3b12f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:55.573435 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48f817e2-b610-4488-b15a-90ab52e3b12f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:55.714091 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-48f817e2-b610-4488-b15a-90ab52e3b12f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:55.722413 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-48f817e2-b610-4488-b15a-90ab52e3b12f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.162871 Aug 05 07:14:55.723021 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 69/148] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:55 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:56.142977 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-87a0eeba-9b70-4085-abe8-f541c4de1af8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:56.143606 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-87a0eeba-9b70-4085-abe8-f541c4de1af8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:56.152918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-87a0eeba-9b70-4085-abe8-f541c4de1af8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:56.154137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-87a0eeba-9b70-4085-abe8-f541c4de1af8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:56.154883 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-87a0eeba-9b70-4085-abe8-f541c4de1af8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:56.156108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-87a0eeba-9b70-4085-abe8-f541c4de1af8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:56.156951 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-87a0eeba-9b70-4085-abe8-f541c4de1af8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:56.157608 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-87a0eeba-9b70-4085-abe8-f541c4de1af8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:56.221181 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-36fa3612-0e1c-464d-b9f1-411f75cee0aa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:56.222850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-36fa3612-0e1c-464d-b9f1-411f75cee0aa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:56.230808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36fa3612-0e1c-464d-b9f1-411f75cee0aa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:56.231042 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36fa3612-0e1c-464d-b9f1-411f75cee0aa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:56.232757 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36fa3612-0e1c-464d-b9f1-411f75cee0aa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:56.233901 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36fa3612-0e1c-464d-b9f1-411f75cee0aa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:56.234721 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36fa3612-0e1c-464d-b9f1-411f75cee0aa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:56.235292 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36fa3612-0e1c-464d-b9f1-411f75cee0aa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:56.308387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-87a0eeba-9b70-4085-abe8-f541c4de1af8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:56.317374 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-87a0eeba-9b70-4085-abe8-f541c4de1af8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.178158 Aug 05 07:14:56.318194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 80/149] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:56 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:56.388098 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-36fa3612-0e1c-464d-b9f1-411f75cee0aa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:56.395717 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-36fa3612-0e1c-464d-b9f1-411f75cee0aa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.179744 Aug 05 07:14:56.396292 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 70/150] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:56 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:56.414609 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b4b4a7f8-64ad-4e62-a02d-5b1d3b760870 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:56.415221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b4b4a7f8-64ad-4e62-a02d-5b1d3b760870 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:56.421670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b4b4a7f8-64ad-4e62-a02d-5b1d3b760870 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:56.422308 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b4b4a7f8-64ad-4e62-a02d-5b1d3b760870 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:56.422952 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b4b4a7f8-64ad-4e62-a02d-5b1d3b760870 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:56.423725 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b4b4a7f8-64ad-4e62-a02d-5b1d3b760870 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:56.424239 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b4b4a7f8-64ad-4e62-a02d-5b1d3b760870 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:56.424725 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b4b4a7f8-64ad-4e62-a02d-5b1d3b760870 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:56.559347 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b4b4a7f8-64ad-4e62-a02d-5b1d3b760870 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:56.568584 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b4b4a7f8-64ad-4e62-a02d-5b1d3b760870 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.157635 Aug 05 07:14:56.569327 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 81/151] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:56 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:56.742889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-16fc4cf9-10a5-4e8d-890a-afc6803bb022 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:56.743496 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-16fc4cf9-10a5-4e8d-890a-afc6803bb022 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:56.750284 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16fc4cf9-10a5-4e8d-890a-afc6803bb022 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:56.750765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16fc4cf9-10a5-4e8d-890a-afc6803bb022 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:56.751491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16fc4cf9-10a5-4e8d-890a-afc6803bb022 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:56.752341 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16fc4cf9-10a5-4e8d-890a-afc6803bb022 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:56.753521 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16fc4cf9-10a5-4e8d-890a-afc6803bb022 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:56.754235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16fc4cf9-10a5-4e8d-890a-afc6803bb022 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:56.893499 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-16fc4cf9-10a5-4e8d-890a-afc6803bb022 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:56.901658 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-16fc4cf9-10a5-4e8d-890a-afc6803bb022 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.162559 Aug 05 07:14:56.902282 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 71/152] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:56 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:57.343677 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1d60f030-ee4e-40a1-affd-951d817ecdc6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:57.344733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1d60f030-ee4e-40a1-affd-951d817ecdc6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:57.354680 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1d60f030-ee4e-40a1-affd-951d817ecdc6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:57.355291 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1d60f030-ee4e-40a1-affd-951d817ecdc6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:57.355923 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1d60f030-ee4e-40a1-affd-951d817ecdc6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:57.356780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1d60f030-ee4e-40a1-affd-951d817ecdc6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:57.357465 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1d60f030-ee4e-40a1-affd-951d817ecdc6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:57.357974 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1d60f030-ee4e-40a1-affd-951d817ecdc6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:57.415535 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-59ff3809-62d2-4f1f-91bc-eabdc8636c25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:57.417003 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-59ff3809-62d2-4f1f-91bc-eabdc8636c25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:57.423263 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59ff3809-62d2-4f1f-91bc-eabdc8636c25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:57.424015 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59ff3809-62d2-4f1f-91bc-eabdc8636c25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:57.424636 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59ff3809-62d2-4f1f-91bc-eabdc8636c25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:57.425367 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59ff3809-62d2-4f1f-91bc-eabdc8636c25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:57.425797 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59ff3809-62d2-4f1f-91bc-eabdc8636c25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:57.426408 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59ff3809-62d2-4f1f-91bc-eabdc8636c25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:57.517762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1d60f030-ee4e-40a1-affd-951d817ecdc6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:57.525516 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1d60f030-ee4e-40a1-affd-951d817ecdc6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.190178 Aug 05 07:14:57.526425 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 82/153] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:57 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:57.573549 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-59ff3809-62d2-4f1f-91bc-eabdc8636c25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:57.581335 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-59ff3809-62d2-4f1f-91bc-eabdc8636c25 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.169451 Aug 05 07:14:57.581920 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 72/154] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:57 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:57.597282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2688ed36-9e72-4517-9f02-918ceecbe98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:57.597993 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2688ed36-9e72-4517-9f02-918ceecbe98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:57.604789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2688ed36-9e72-4517-9f02-918ceecbe98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:57.605467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2688ed36-9e72-4517-9f02-918ceecbe98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:57.605974 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2688ed36-9e72-4517-9f02-918ceecbe98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:57.606761 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2688ed36-9e72-4517-9f02-918ceecbe98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:57.607223 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2688ed36-9e72-4517-9f02-918ceecbe98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:57.607650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2688ed36-9e72-4517-9f02-918ceecbe98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:57.742583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2688ed36-9e72-4517-9f02-918ceecbe98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:57.750434 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2688ed36-9e72-4517-9f02-918ceecbe98f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.157230 Aug 05 07:14:57.751007 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 83/155] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:57 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:57.931922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-824a403f-051b-4f0f-aaa2-617ed6327a07 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:57.932553 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-824a403f-051b-4f0f-aaa2-617ed6327a07 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:57.939167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-824a403f-051b-4f0f-aaa2-617ed6327a07 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:57.939630 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-824a403f-051b-4f0f-aaa2-617ed6327a07 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:57.940102 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-824a403f-051b-4f0f-aaa2-617ed6327a07 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:57.940802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-824a403f-051b-4f0f-aaa2-617ed6327a07 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:57.941297 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-824a403f-051b-4f0f-aaa2-617ed6327a07 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:57.941703 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-824a403f-051b-4f0f-aaa2-617ed6327a07 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:58.100191 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-824a403f-051b-4f0f-aaa2-617ed6327a07 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:58.109024 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-824a403f-051b-4f0f-aaa2-617ed6327a07 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.189837 Aug 05 07:14:58.111909 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 73/156] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:57 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:58.547476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5f876fa7-e0ab-4016-81ec-8eb6a787b8d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:58.548211 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5f876fa7-e0ab-4016-81ec-8eb6a787b8d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:58.554535 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5f876fa7-e0ab-4016-81ec-8eb6a787b8d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:58.555040 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5f876fa7-e0ab-4016-81ec-8eb6a787b8d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:58.555468 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5f876fa7-e0ab-4016-81ec-8eb6a787b8d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:58.556170 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5f876fa7-e0ab-4016-81ec-8eb6a787b8d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:58.556643 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5f876fa7-e0ab-4016-81ec-8eb6a787b8d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:58.557098 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5f876fa7-e0ab-4016-81ec-8eb6a787b8d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:58.604167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cfdc96b4-24d3-4931-9bfe-c8fa7305c30e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:58.604837 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cfdc96b4-24d3-4931-9bfe-c8fa7305c30e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:58.611731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cfdc96b4-24d3-4931-9bfe-c8fa7305c30e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:58.612493 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cfdc96b4-24d3-4931-9bfe-c8fa7305c30e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:58.612929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cfdc96b4-24d3-4931-9bfe-c8fa7305c30e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:58.613660 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cfdc96b4-24d3-4931-9bfe-c8fa7305c30e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:58.614099 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cfdc96b4-24d3-4931-9bfe-c8fa7305c30e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:58.614527 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cfdc96b4-24d3-4931-9bfe-c8fa7305c30e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:58.693698 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5f876fa7-e0ab-4016-81ec-8eb6a787b8d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:58.704508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5f876fa7-e0ab-4016-81ec-8eb6a787b8d4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.161025 Aug 05 07:14:58.705139 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 84/157] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:58 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:58.771018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cfdc96b4-24d3-4931-9bfe-c8fa7305c30e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:58.776829 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7b67ad5a-7209-4162-a061-bab433d4c48d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:58.777878 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7b67ad5a-7209-4162-a061-bab433d4c48d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:58.784845 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7b67ad5a-7209-4162-a061-bab433d4c48d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:58.785478 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7b67ad5a-7209-4162-a061-bab433d4c48d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:58.786080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7b67ad5a-7209-4162-a061-bab433d4c48d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:58.786808 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7b67ad5a-7209-4162-a061-bab433d4c48d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:58.787255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7b67ad5a-7209-4162-a061-bab433d4c48d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:58.787359 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cfdc96b4-24d3-4931-9bfe-c8fa7305c30e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.189134 Aug 05 07:14:58.787845 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7b67ad5a-7209-4162-a061-bab433d4c48d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:58.788939 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 74/158] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:58 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:58.940791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7b67ad5a-7209-4162-a061-bab433d4c48d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:58.949880 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7b67ad5a-7209-4162-a061-bab433d4c48d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.182662 Aug 05 07:14:58.950537 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 85/159] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:58 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:59.134283 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b588ac95-8d01-4aca-8fd3-2bec63ec3fae tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:59.135253 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b588ac95-8d01-4aca-8fd3-2bec63ec3fae tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:59.148542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b588ac95-8d01-4aca-8fd3-2bec63ec3fae tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:59.149081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b588ac95-8d01-4aca-8fd3-2bec63ec3fae tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:59.149523 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b588ac95-8d01-4aca-8fd3-2bec63ec3fae tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:59.150546 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b588ac95-8d01-4aca-8fd3-2bec63ec3fae tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:59.151316 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b588ac95-8d01-4aca-8fd3-2bec63ec3fae tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:59.151968 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b588ac95-8d01-4aca-8fd3-2bec63ec3fae tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:59.308022 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b588ac95-8d01-4aca-8fd3-2bec63ec3fae tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:59.317640 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b588ac95-8d01-4aca-8fd3-2bec63ec3fae tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.187365 Aug 05 07:14:59.320955 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 75/160] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:59 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:59.727057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ca1a7ec2-ed8a-4164-be55-c7626ff57fcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:59.728441 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ca1a7ec2-ed8a-4164-be55-c7626ff57fcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:59.735467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ca1a7ec2-ed8a-4164-be55-c7626ff57fcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:59.736036 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ca1a7ec2-ed8a-4164-be55-c7626ff57fcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:59.736657 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ca1a7ec2-ed8a-4164-be55-c7626ff57fcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:59.737373 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ca1a7ec2-ed8a-4164-be55-c7626ff57fcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:59.738132 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ca1a7ec2-ed8a-4164-be55-c7626ff57fcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:59.738599 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ca1a7ec2-ed8a-4164-be55-c7626ff57fcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:59.808433 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4f75646d-8de5-4e78-88fb-4470177f19ab tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:59.809057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4f75646d-8de5-4e78-88fb-4470177f19ab tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:59.815641 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f75646d-8de5-4e78-88fb-4470177f19ab tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:59.816151 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f75646d-8de5-4e78-88fb-4470177f19ab tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:59.816847 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f75646d-8de5-4e78-88fb-4470177f19ab tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:59.817663 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f75646d-8de5-4e78-88fb-4470177f19ab tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:59.818121 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f75646d-8de5-4e78-88fb-4470177f19ab tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:59.818535 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f75646d-8de5-4e78-88fb-4470177f19ab tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:59.887580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ca1a7ec2-ed8a-4164-be55-c7626ff57fcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:14:59.898374 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ca1a7ec2-ed8a-4164-be55-c7626ff57fcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.175657 Aug 05 07:14:59.911751 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 86/161] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:59 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:14:59.972076 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8bc356de-11fe-49a0-a44c-2a4fdf0d2d75 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:14:59.972962 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8bc356de-11fe-49a0-a44c-2a4fdf0d2d75 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:14:59.980974 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8bc356de-11fe-49a0-a44c-2a4fdf0d2d75 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:59.982742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8bc356de-11fe-49a0-a44c-2a4fdf0d2d75 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:59.983538 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8bc356de-11fe-49a0-a44c-2a4fdf0d2d75 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:59.984919 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8bc356de-11fe-49a0-a44c-2a4fdf0d2d75 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:14:59.986419 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8bc356de-11fe-49a0-a44c-2a4fdf0d2d75 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:14:59.987469 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8bc356de-11fe-49a0-a44c-2a4fdf0d2d75 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:14:59.996555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:00.002596 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4f75646d-8de5-4e78-88fb-4470177f19ab tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:00.008963 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:00.013179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4f75646d-8de5-4e78-88fb-4470177f19ab tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.208304 Aug 05 07:15:00.023940 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 76/162] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:59 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:00.179620 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-8bc356de-11fe-49a0-a44c-2a4fdf0d2d75 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:00.188317 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8bc356de-11fe-49a0-a44c-2a4fdf0d2d75 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.220691 Aug 05 07:15:00.189026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 87/163] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:14:59 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:00.345463 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f9a1de2b-da78-4804-ac54-99875403601b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:00.345463 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f9a1de2b-da78-4804-ac54-99875403601b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:00.349453 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9a1de2b-da78-4804-ac54-99875403601b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:00.349941 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9a1de2b-da78-4804-ac54-99875403601b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:00.350364 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9a1de2b-da78-4804-ac54-99875403601b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:00.351077 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9a1de2b-da78-4804-ac54-99875403601b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:00.351507 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9a1de2b-da78-4804-ac54-99875403601b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:00.351927 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9a1de2b-da78-4804-ac54-99875403601b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:00.512387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f9a1de2b-da78-4804-ac54-99875403601b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:00.521008 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f9a1de2b-da78-4804-ac54-99875403601b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.185642 Aug 05 07:15:00.521599 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 77/164] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:00 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:00.682662 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-0cb5613e-5949-4a19-be76-c96e58d88979 req-0b992bd4-9d62-42a1-9432-c38efe933599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8759583-2a52-42ed-a5e0-c72a7000b211", "name": "network-vif-plugged", "status": "completed", "tag": "1869529c-7cd6-42c5-9f0a-5d9ae0e48a24"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:00.696557 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-0cb5613e-5949-4a19-be76-c96e58d88979 req-0b992bd4-9d62-42a1-9432-c38efe933599 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:00.697247 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-0cb5613e-5949-4a19-be76-c96e58d88979 req-0b992bd4-9d62-42a1-9432-c38efe933599 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:00.697905 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-0cb5613e-5949-4a19-be76-c96e58d88979 req-0b992bd4-9d62-42a1-9432-c38efe933599 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:00.714409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-0cb5613e-5949-4a19-be76-c96e58d88979 req-0b992bd4-9d62-42a1-9432-c38efe933599 service nova] Creating event network-vif-plugged:1869529c-7cd6-42c5-9f0a-5d9ae0e48a24 for instance c8759583-2a52-42ed-a5e0-c72a7000b211 on hv-cinder-85200 Aug 05 07:15:00.722014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-0cb5613e-5949-4a19-be76-c96e58d88979 req-0b992bd4-9d62-42a1-9432-c38efe933599 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042747 Aug 05 07:15:00.722779 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 88/165] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:15:00.919929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-688b67c7-7ee1-48de-ad58-423810138c1f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:00.920487 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-688b67c7-7ee1-48de-ad58-423810138c1f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:00.927444 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-688b67c7-7ee1-48de-ad58-423810138c1f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:00.928192 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-688b67c7-7ee1-48de-ad58-423810138c1f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:00.928456 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-688b67c7-7ee1-48de-ad58-423810138c1f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:00.929096 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-688b67c7-7ee1-48de-ad58-423810138c1f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:00.929552 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-688b67c7-7ee1-48de-ad58-423810138c1f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:00.930005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-688b67c7-7ee1-48de-ad58-423810138c1f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:01.036928 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-095b3e7c-1e70-42c5-ab31-f7f48625e542 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:01.038167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-095b3e7c-1e70-42c5-ab31-f7f48625e542 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:01.045073 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-095b3e7c-1e70-42c5-ab31-f7f48625e542 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:01.045557 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-095b3e7c-1e70-42c5-ab31-f7f48625e542 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:01.045982 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-095b3e7c-1e70-42c5-ab31-f7f48625e542 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:01.046697 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-095b3e7c-1e70-42c5-ab31-f7f48625e542 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:01.047149 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-095b3e7c-1e70-42c5-ab31-f7f48625e542 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:01.047556 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-095b3e7c-1e70-42c5-ab31-f7f48625e542 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:01.167194 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-688b67c7-7ee1-48de-ad58-423810138c1f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:01.184312 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-688b67c7-7ee1-48de-ad58-423810138c1f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.266205 Aug 05 07:15:01.187868 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 78/166] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:00 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:01.218747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cecb662d-5e3f-47f2-a2ae-bc7a719a5265 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:01.219962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cecb662d-5e3f-47f2-a2ae-bc7a719a5265 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:01.246315 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cecb662d-5e3f-47f2-a2ae-bc7a719a5265 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:01.253481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cecb662d-5e3f-47f2-a2ae-bc7a719a5265 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:01.255579 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cecb662d-5e3f-47f2-a2ae-bc7a719a5265 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:01.265071 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cecb662d-5e3f-47f2-a2ae-bc7a719a5265 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:01.266760 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cecb662d-5e3f-47f2-a2ae-bc7a719a5265 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:01.270978 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cecb662d-5e3f-47f2-a2ae-bc7a719a5265 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:01.635782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-095b3e7c-1e70-42c5-ab31-f7f48625e542 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:01.645305 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-095b3e7c-1e70-42c5-ab31-f7f48625e542 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.613361 Aug 05 07:15:01.645891 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 89/167] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:01 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:01.646408 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cecb662d-5e3f-47f2-a2ae-bc7a719a5265 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:01.652241 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d40976f9-198f-4449-830a-0eec5399b1ca tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:01.653582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d40976f9-198f-4449-830a-0eec5399b1ca tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:01.657908 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cecb662d-5e3f-47f2-a2ae-bc7a719a5265 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.451222 Aug 05 07:15:01.660757 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d40976f9-198f-4449-830a-0eec5399b1ca tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:01.661522 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d40976f9-198f-4449-830a-0eec5399b1ca tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:01.662341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d40976f9-198f-4449-830a-0eec5399b1ca tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:01.663613 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d40976f9-198f-4449-830a-0eec5399b1ca tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:01.664218 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d40976f9-198f-4449-830a-0eec5399b1ca tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:01.664829 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d40976f9-198f-4449-830a-0eec5399b1ca tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:01.671246 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 79/168] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:01 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:02.061388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d40976f9-198f-4449-830a-0eec5399b1ca tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:02.070320 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d40976f9-198f-4449-830a-0eec5399b1ca tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.422676 Aug 05 07:15:02.071045 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 90/169] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:01 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:02.206131 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d6ba3f89-7ed3-4616-a680-ef951b639a15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:02.208446 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d6ba3f89-7ed3-4616-a680-ef951b639a15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:02.215202 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6ba3f89-7ed3-4616-a680-ef951b639a15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:02.215544 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6ba3f89-7ed3-4616-a680-ef951b639a15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:02.216139 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6ba3f89-7ed3-4616-a680-ef951b639a15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:02.217448 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6ba3f89-7ed3-4616-a680-ef951b639a15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:02.217910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6ba3f89-7ed3-4616-a680-ef951b639a15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:02.218328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6ba3f89-7ed3-4616-a680-ef951b639a15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:02.420512 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d6ba3f89-7ed3-4616-a680-ef951b639a15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:02.428432 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d6ba3f89-7ed3-4616-a680-ef951b639a15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.226652 Aug 05 07:15:02.429018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 80/170] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:02 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:02.669577 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-59e92ae2-4ece-4fb8-9de1-66cfb94b530c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:02.670198 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-59e92ae2-4ece-4fb8-9de1-66cfb94b530c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:02.677241 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-59e92ae2-4ece-4fb8-9de1-66cfb94b530c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:02.677600 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-59e92ae2-4ece-4fb8-9de1-66cfb94b530c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:02.678044 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-59e92ae2-4ece-4fb8-9de1-66cfb94b530c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:02.678726 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fb172bd8-75d1-4415-86a8-1015b3c4eec8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:02.678903 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-59e92ae2-4ece-4fb8-9de1-66cfb94b530c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:02.679197 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-59e92ae2-4ece-4fb8-9de1-66cfb94b530c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:02.679595 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fb172bd8-75d1-4415-86a8-1015b3c4eec8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:02.679775 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-59e92ae2-4ece-4fb8-9de1-66cfb94b530c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:02.687503 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fb172bd8-75d1-4415-86a8-1015b3c4eec8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:02.688102 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fb172bd8-75d1-4415-86a8-1015b3c4eec8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:02.688686 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fb172bd8-75d1-4415-86a8-1015b3c4eec8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:02.689539 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fb172bd8-75d1-4415-86a8-1015b3c4eec8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:02.690171 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fb172bd8-75d1-4415-86a8-1015b3c4eec8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:02.690733 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fb172bd8-75d1-4415-86a8-1015b3c4eec8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:02.827990 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fb172bd8-75d1-4415-86a8-1015b3c4eec8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:02.835644 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fb172bd8-75d1-4415-86a8-1015b3c4eec8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.161897 Aug 05 07:15:02.836212 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 81/171] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:02 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:02.861383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-59e92ae2-4ece-4fb8-9de1-66cfb94b530c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:02.868995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-59e92ae2-4ece-4fb8-9de1-66cfb94b530c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.203329 Aug 05 07:15:02.869581 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 91/172] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:02 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:03.091605 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5db1838a-0eba-4cce-8ddd-bfdc2c8f1faf tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:03.092218 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5db1838a-0eba-4cce-8ddd-bfdc2c8f1faf tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:03.098610 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5db1838a-0eba-4cce-8ddd-bfdc2c8f1faf tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:03.099105 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5db1838a-0eba-4cce-8ddd-bfdc2c8f1faf tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:03.099542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5db1838a-0eba-4cce-8ddd-bfdc2c8f1faf tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:03.100219 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5db1838a-0eba-4cce-8ddd-bfdc2c8f1faf tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:03.100678 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5db1838a-0eba-4cce-8ddd-bfdc2c8f1faf tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:03.101134 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5db1838a-0eba-4cce-8ddd-bfdc2c8f1faf tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:03.236512 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5db1838a-0eba-4cce-8ddd-bfdc2c8f1faf tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:03.244229 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5db1838a-0eba-4cce-8ddd-bfdc2c8f1faf tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.156709 Aug 05 07:15:03.244807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 82/173] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:03 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:03.448941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-41d00556-4037-4fa0-b4dd-bb7c68d61f5f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:03.449502 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-41d00556-4037-4fa0-b4dd-bb7c68d61f5f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:03.456111 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-41d00556-4037-4fa0-b4dd-bb7c68d61f5f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:03.456610 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-41d00556-4037-4fa0-b4dd-bb7c68d61f5f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:03.457246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-41d00556-4037-4fa0-b4dd-bb7c68d61f5f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:03.458208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-41d00556-4037-4fa0-b4dd-bb7c68d61f5f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:03.458621 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-41d00556-4037-4fa0-b4dd-bb7c68d61f5f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:03.459213 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-41d00556-4037-4fa0-b4dd-bb7c68d61f5f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:03.592210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-41d00556-4037-4fa0-b4dd-bb7c68d61f5f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:03.599843 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-41d00556-4037-4fa0-b4dd-bb7c68d61f5f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.155017 Aug 05 07:15:03.600447 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 92/174] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:03 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:03.855758 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-83c85b73-022e-4dfe-a99f-ccb4e5de23aa tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:03.856396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-83c85b73-022e-4dfe-a99f-ccb4e5de23aa tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:03.863005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83c85b73-022e-4dfe-a99f-ccb4e5de23aa tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:03.863491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83c85b73-022e-4dfe-a99f-ccb4e5de23aa tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:03.863921 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83c85b73-022e-4dfe-a99f-ccb4e5de23aa tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:03.864607 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83c85b73-022e-4dfe-a99f-ccb4e5de23aa tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:03.865075 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83c85b73-022e-4dfe-a99f-ccb4e5de23aa tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:03.865497 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83c85b73-022e-4dfe-a99f-ccb4e5de23aa tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:03.890056 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-76361671-042e-4cbf-9371-9839358977d1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:03.890578 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-76361671-042e-4cbf-9371-9839358977d1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:03.896945 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-76361671-042e-4cbf-9371-9839358977d1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:03.897436 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-76361671-042e-4cbf-9371-9839358977d1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:03.897874 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-76361671-042e-4cbf-9371-9839358977d1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:03.898564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-76361671-042e-4cbf-9371-9839358977d1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:03.899006 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-76361671-042e-4cbf-9371-9839358977d1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:03.899446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-76361671-042e-4cbf-9371-9839358977d1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:04.006024 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-83c85b73-022e-4dfe-a99f-ccb4e5de23aa tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:04.013839 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-83c85b73-022e-4dfe-a99f-ccb4e5de23aa tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.161974 Aug 05 07:15:04.014588 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 83/175] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:03 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:04.039485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-76361671-042e-4cbf-9371-9839358977d1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:04.047181 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-76361671-042e-4cbf-9371-9839358977d1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.161277 Aug 05 07:15:04.047761 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 93/176] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:03 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:04.264559 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3d550dce-af76-4365-bdc2-14d890f829c6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:04.265144 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3d550dce-af76-4365-bdc2-14d890f829c6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:04.271445 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d550dce-af76-4365-bdc2-14d890f829c6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:04.271923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d550dce-af76-4365-bdc2-14d890f829c6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:04.272350 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d550dce-af76-4365-bdc2-14d890f829c6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:04.273059 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d550dce-af76-4365-bdc2-14d890f829c6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:04.273507 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d550dce-af76-4365-bdc2-14d890f829c6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:04.273933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d550dce-af76-4365-bdc2-14d890f829c6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:04.403728 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3d550dce-af76-4365-bdc2-14d890f829c6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:04.411522 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3d550dce-af76-4365-bdc2-14d890f829c6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.151040 Aug 05 07:15:04.412070 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 84/177] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:04 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:04.620415 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-bf247c5b-26c6-4039-9560-15305dff7521 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:04.621274 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-bf247c5b-26c6-4039-9560-15305dff7521 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:04.627723 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf247c5b-26c6-4039-9560-15305dff7521 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:04.628416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf247c5b-26c6-4039-9560-15305dff7521 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:04.629025 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf247c5b-26c6-4039-9560-15305dff7521 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:04.629901 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf247c5b-26c6-4039-9560-15305dff7521 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:04.630350 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf247c5b-26c6-4039-9560-15305dff7521 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:04.630777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf247c5b-26c6-4039-9560-15305dff7521 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:04.779601 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-bf247c5b-26c6-4039-9560-15305dff7521 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:04.787726 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-bf247c5b-26c6-4039-9560-15305dff7521 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.170981 Aug 05 07:15:04.788229 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 94/178] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:04 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:05.037046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0267f452-ea8f-4eeb-8f92-6fa05668b5fe tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:05.037660 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0267f452-ea8f-4eeb-8f92-6fa05668b5fe tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:05.044947 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0267f452-ea8f-4eeb-8f92-6fa05668b5fe tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:05.045469 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0267f452-ea8f-4eeb-8f92-6fa05668b5fe tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:05.045896 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0267f452-ea8f-4eeb-8f92-6fa05668b5fe tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:05.046558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0267f452-ea8f-4eeb-8f92-6fa05668b5fe tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:05.047150 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0267f452-ea8f-4eeb-8f92-6fa05668b5fe tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:05.047438 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0267f452-ea8f-4eeb-8f92-6fa05668b5fe tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:05.069661 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-44dd4561-3f97-4a09-866a-f979dbfdcdb8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:05.070849 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-44dd4561-3f97-4a09-866a-f979dbfdcdb8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:05.077647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-44dd4561-3f97-4a09-866a-f979dbfdcdb8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:05.078128 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-44dd4561-3f97-4a09-866a-f979dbfdcdb8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:05.078545 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-44dd4561-3f97-4a09-866a-f979dbfdcdb8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:05.079321 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-44dd4561-3f97-4a09-866a-f979dbfdcdb8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:05.079771 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-44dd4561-3f97-4a09-866a-f979dbfdcdb8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:05.080186 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-44dd4561-3f97-4a09-866a-f979dbfdcdb8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:05.186328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0267f452-ea8f-4eeb-8f92-6fa05668b5fe tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:05.194312 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0267f452-ea8f-4eeb-8f92-6fa05668b5fe tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.161072 Aug 05 07:15:05.194905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 85/179] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:05 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:05.218440 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-44dd4561-3f97-4a09-866a-f979dbfdcdb8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:05.226284 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-44dd4561-3f97-4a09-866a-f979dbfdcdb8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.160939 Aug 05 07:15:05.226856 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 95/180] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:05 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:05.432789 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b0faab26-d4b5-483e-bfcc-dfa238bb923b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:05.433467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b0faab26-d4b5-483e-bfcc-dfa238bb923b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:05.440097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b0faab26-d4b5-483e-bfcc-dfa238bb923b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:05.440581 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b0faab26-d4b5-483e-bfcc-dfa238bb923b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:05.441055 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b0faab26-d4b5-483e-bfcc-dfa238bb923b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:05.441755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b0faab26-d4b5-483e-bfcc-dfa238bb923b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:05.442197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b0faab26-d4b5-483e-bfcc-dfa238bb923b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:05.442601 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b0faab26-d4b5-483e-bfcc-dfa238bb923b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:05.582722 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b0faab26-d4b5-483e-bfcc-dfa238bb923b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:05.590613 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b0faab26-d4b5-483e-bfcc-dfa238bb923b tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.161918 Aug 05 07:15:05.591289 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 86/181] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:05 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:05.808404 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-53001121-fa51-4ee5-8e6d-4084058e57a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:05.809048 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-53001121-fa51-4ee5-8e6d-4084058e57a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:05.815675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-53001121-fa51-4ee5-8e6d-4084058e57a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:05.816166 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-53001121-fa51-4ee5-8e6d-4084058e57a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:05.816763 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-53001121-fa51-4ee5-8e6d-4084058e57a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:05.818762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-53001121-fa51-4ee5-8e6d-4084058e57a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:05.818762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-53001121-fa51-4ee5-8e6d-4084058e57a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:05.818762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-53001121-fa51-4ee5-8e6d-4084058e57a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:05.958203 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-53001121-fa51-4ee5-8e6d-4084058e57a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:05.966737 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-53001121-fa51-4ee5-8e6d-4084058e57a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.162127 Aug 05 07:15:05.967416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 96/182] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:05 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:06.215309 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0dfc3242-ecc4-4f1a-80a3-90286bbc160c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:06.215790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0dfc3242-ecc4-4f1a-80a3-90286bbc160c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:06.217950 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:06.223606 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dfc3242-ecc4-4f1a-80a3-90286bbc160c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:06.224081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dfc3242-ecc4-4f1a-80a3-90286bbc160c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:06.224511 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dfc3242-ecc4-4f1a-80a3-90286bbc160c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:06.225229 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dfc3242-ecc4-4f1a-80a3-90286bbc160c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:06.225675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dfc3242-ecc4-4f1a-80a3-90286bbc160c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:06.226097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dfc3242-ecc4-4f1a-80a3-90286bbc160c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:06.246899 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3557bbb5-6097-476c-bad5-274cbe842fdb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:06.247476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3557bbb5-6097-476c-bad5-274cbe842fdb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:06.254044 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3557bbb5-6097-476c-bad5-274cbe842fdb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:06.254532 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3557bbb5-6097-476c-bad5-274cbe842fdb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:06.254971 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3557bbb5-6097-476c-bad5-274cbe842fdb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:06.255664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3557bbb5-6097-476c-bad5-274cbe842fdb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:06.256120 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3557bbb5-6097-476c-bad5-274cbe842fdb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:06.256545 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3557bbb5-6097-476c-bad5-274cbe842fdb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:06.361701 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0dfc3242-ecc4-4f1a-80a3-90286bbc160c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:06.369593 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0dfc3242-ecc4-4f1a-80a3-90286bbc160c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.158335 Aug 05 07:15:06.370246 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 87/183] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:06 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:06.396210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3557bbb5-6097-476c-bad5-274cbe842fdb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:06.404185 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3557bbb5-6097-476c-bad5-274cbe842fdb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.161289 Aug 05 07:15:06.404728 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 97/184] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:06 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:06.611641 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-47198245-0e6a-42f4-8550-b2a95faf7554 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:06.612237 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-47198245-0e6a-42f4-8550-b2a95faf7554 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:06.618712 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-47198245-0e6a-42f4-8550-b2a95faf7554 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:06.619190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-47198245-0e6a-42f4-8550-b2a95faf7554 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:06.619616 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-47198245-0e6a-42f4-8550-b2a95faf7554 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:06.620296 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-47198245-0e6a-42f4-8550-b2a95faf7554 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:06.620739 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-47198245-0e6a-42f4-8550-b2a95faf7554 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:06.621189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-47198245-0e6a-42f4-8550-b2a95faf7554 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:06.760362 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-47198245-0e6a-42f4-8550-b2a95faf7554 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:06.768034 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-47198245-0e6a-42f4-8550-b2a95faf7554 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.160324 Aug 05 07:15:06.768705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 88/185] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:06 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:06.987639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-758b19d1-e71b-4534-a26c-d1a0063c8619 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:06.988252 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-758b19d1-e71b-4534-a26c-d1a0063c8619 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:06.994690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-758b19d1-e71b-4534-a26c-d1a0063c8619 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:06.995171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-758b19d1-e71b-4534-a26c-d1a0063c8619 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:06.995601 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-758b19d1-e71b-4534-a26c-d1a0063c8619 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:06.996357 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-758b19d1-e71b-4534-a26c-d1a0063c8619 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:06.996828 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-758b19d1-e71b-4534-a26c-d1a0063c8619 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:06.997397 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-758b19d1-e71b-4534-a26c-d1a0063c8619 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:07.132823 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-758b19d1-e71b-4534-a26c-d1a0063c8619 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:07.140661 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-758b19d1-e71b-4534-a26c-d1a0063c8619 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.157058 Aug 05 07:15:07.141264 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 98/186] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:06 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:07.392855 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-153c3596-743d-45a4-9810-30b52c19200b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:07.393750 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-153c3596-743d-45a4-9810-30b52c19200b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:07.405888 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-153c3596-743d-45a4-9810-30b52c19200b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:07.407652 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-153c3596-743d-45a4-9810-30b52c19200b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:07.409504 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-153c3596-743d-45a4-9810-30b52c19200b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:07.412780 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-153c3596-743d-45a4-9810-30b52c19200b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:07.413482 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-153c3596-743d-45a4-9810-30b52c19200b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:07.413911 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-153c3596-743d-45a4-9810-30b52c19200b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:07.429269 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-cabb6fa5-524e-47c5-aca0-b456dd3c98ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:07.431255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-cabb6fa5-524e-47c5-aca0-b456dd3c98ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:07.449670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cabb6fa5-524e-47c5-aca0-b456dd3c98ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:07.450523 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cabb6fa5-524e-47c5-aca0-b456dd3c98ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:07.453338 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cabb6fa5-524e-47c5-aca0-b456dd3c98ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:07.454263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cabb6fa5-524e-47c5-aca0-b456dd3c98ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:07.456125 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cabb6fa5-524e-47c5-aca0-b456dd3c98ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:07.456748 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cabb6fa5-524e-47c5-aca0-b456dd3c98ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:07.597097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-153c3596-743d-45a4-9810-30b52c19200b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:07.608007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-153c3596-743d-45a4-9810-30b52c19200b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.219797 Aug 05 07:15:07.614739 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 89/187] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:07 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:07.668671 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cabb6fa5-524e-47c5-aca0-b456dd3c98ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:07.677244 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-cabb6fa5-524e-47c5-aca0-b456dd3c98ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.255788 Aug 05 07:15:07.677997 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 99/188] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:07 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:07.789871 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-44ad2bca-592f-47e4-9f1b-e29cb6f71e45 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:07.790452 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-44ad2bca-592f-47e4-9f1b-e29cb6f71e45 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:07.796877 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44ad2bca-592f-47e4-9f1b-e29cb6f71e45 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:07.797568 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44ad2bca-592f-47e4-9f1b-e29cb6f71e45 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:07.798203 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44ad2bca-592f-47e4-9f1b-e29cb6f71e45 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:07.798697 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44ad2bca-592f-47e4-9f1b-e29cb6f71e45 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:07.799162 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44ad2bca-592f-47e4-9f1b-e29cb6f71e45 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:07.799814 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44ad2bca-592f-47e4-9f1b-e29cb6f71e45 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:07.984387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-44ad2bca-592f-47e4-9f1b-e29cb6f71e45 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:07.993457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-44ad2bca-592f-47e4-9f1b-e29cb6f71e45 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.207499 Aug 05 07:15:07.994442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 90/189] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:07 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:08.171093 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ceb860a5-1765-4609-b6d3-03f15a0785d0 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:08.171647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ceb860a5-1765-4609-b6d3-03f15a0785d0 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:08.179091 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ceb860a5-1765-4609-b6d3-03f15a0785d0 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:08.180084 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ceb860a5-1765-4609-b6d3-03f15a0785d0 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:08.180719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ceb860a5-1765-4609-b6d3-03f15a0785d0 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:08.181929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ceb860a5-1765-4609-b6d3-03f15a0785d0 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:08.182691 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ceb860a5-1765-4609-b6d3-03f15a0785d0 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:08.183311 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ceb860a5-1765-4609-b6d3-03f15a0785d0 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:08.252695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-0663abe7-9c83-4a53-bd62-cb6af592e839 req-9269eec3-076d-48da-802a-4e7f85103d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "076d8f98-2ac9-4f41-ad6b-41eaa1428706", "name": "network-vif-plugged", "status": "completed", "tag": "a999eb01-1d23-4a60-b75e-1af095c98abc"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:08.270498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0663abe7-9c83-4a53-bd62-cb6af592e839 req-9269eec3-076d-48da-802a-4e7f85103d80 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:08.271185 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0663abe7-9c83-4a53-bd62-cb6af592e839 req-9269eec3-076d-48da-802a-4e7f85103d80 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:08.271843 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0663abe7-9c83-4a53-bd62-cb6af592e839 req-9269eec3-076d-48da-802a-4e7f85103d80 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:08.301839 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-0663abe7-9c83-4a53-bd62-cb6af592e839 req-9269eec3-076d-48da-802a-4e7f85103d80 service nova] Creating event network-vif-plugged:a999eb01-1d23-4a60-b75e-1af095c98abc for instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 on hv-cinder-85200 Aug 05 07:15:08.307711 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-0663abe7-9c83-4a53-bd62-cb6af592e839 req-9269eec3-076d-48da-802a-4e7f85103d80 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061210 Aug 05 07:15:08.309096 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 91/190] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:15:08.358596 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ceb860a5-1765-4609-b6d3-03f15a0785d0 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:08.369286 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ceb860a5-1765-4609-b6d3-03f15a0785d0 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.207333 Aug 05 07:15:08.370550 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 100/191] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:08 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:08.635141 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-35beeb54-05b1-4f28-a120-2d8f42f6d17f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:08.635844 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-35beeb54-05b1-4f28-a120-2d8f42f6d17f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:08.642165 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35beeb54-05b1-4f28-a120-2d8f42f6d17f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:08.642645 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35beeb54-05b1-4f28-a120-2d8f42f6d17f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:08.643084 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35beeb54-05b1-4f28-a120-2d8f42f6d17f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:08.643773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35beeb54-05b1-4f28-a120-2d8f42f6d17f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:08.644299 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35beeb54-05b1-4f28-a120-2d8f42f6d17f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:08.644642 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35beeb54-05b1-4f28-a120-2d8f42f6d17f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:08.698500 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-683f000f-f9c3-44db-b5fc-3daad59ff158 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:08.699015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-683f000f-f9c3-44db-b5fc-3daad59ff158 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:08.705383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-683f000f-f9c3-44db-b5fc-3daad59ff158 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:08.705863 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-683f000f-f9c3-44db-b5fc-3daad59ff158 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:08.706292 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-683f000f-f9c3-44db-b5fc-3daad59ff158 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:08.706987 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-683f000f-f9c3-44db-b5fc-3daad59ff158 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:08.707437 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-683f000f-f9c3-44db-b5fc-3daad59ff158 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:08.707861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-683f000f-f9c3-44db-b5fc-3daad59ff158 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:08.845347 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-683f000f-f9c3-44db-b5fc-3daad59ff158 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:08.853662 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-683f000f-f9c3-44db-b5fc-3daad59ff158 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.159336 Aug 05 07:15:08.854448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 101/192] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:08 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:08.869951 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-35beeb54-05b1-4f28-a120-2d8f42f6d17f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:08.889077 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-35beeb54-05b1-4f28-a120-2d8f42f6d17f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.258076 Aug 05 07:15:08.889678 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 92/193] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:08 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:09.014944 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ecec3673-460d-446d-8c33-59c667c70165 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:09.015610 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ecec3673-460d-446d-8c33-59c667c70165 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:09.028861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ecec3673-460d-446d-8c33-59c667c70165 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:09.030802 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ecec3673-460d-446d-8c33-59c667c70165 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:09.033886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ecec3673-460d-446d-8c33-59c667c70165 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:09.034907 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ecec3673-460d-446d-8c33-59c667c70165 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:09.037349 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ecec3673-460d-446d-8c33-59c667c70165 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:09.037914 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ecec3673-460d-446d-8c33-59c667c70165 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:09.227554 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ecec3673-460d-446d-8c33-59c667c70165 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:09.242011 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ecec3673-460d-446d-8c33-59c667c70165 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.230998 Aug 05 07:15:09.255767 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 102/194] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:09 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:09.390818 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-06c58f5e-4d23-4697-acf7-3a251f5f8817 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:09.391423 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-06c58f5e-4d23-4697-acf7-3a251f5f8817 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:09.399606 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06c58f5e-4d23-4697-acf7-3a251f5f8817 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:09.400097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06c58f5e-4d23-4697-acf7-3a251f5f8817 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:09.402119 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06c58f5e-4d23-4697-acf7-3a251f5f8817 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:09.403151 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06c58f5e-4d23-4697-acf7-3a251f5f8817 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:09.403733 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06c58f5e-4d23-4697-acf7-3a251f5f8817 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:09.404131 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06c58f5e-4d23-4697-acf7-3a251f5f8817 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:09.574665 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-06c58f5e-4d23-4697-acf7-3a251f5f8817 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:09.591643 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-06c58f5e-4d23-4697-acf7-3a251f5f8817 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.205225 Aug 05 07:15:09.593201 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 93/195] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:09 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:09.877754 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e22c0805-d894-4275-88a4-202bcd17328f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:09.878732 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e22c0805-d894-4275-88a4-202bcd17328f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:09.894602 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e22c0805-d894-4275-88a4-202bcd17328f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:09.897225 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e22c0805-d894-4275-88a4-202bcd17328f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:09.898050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e22c0805-d894-4275-88a4-202bcd17328f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:09.898956 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e22c0805-d894-4275-88a4-202bcd17328f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:09.899450 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e22c0805-d894-4275-88a4-202bcd17328f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:09.900071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e22c0805-d894-4275-88a4-202bcd17328f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:09.915993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5082229b-d8db-4f4c-b177-03d0887e2c42 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:09.916833 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5082229b-d8db-4f4c-b177-03d0887e2c42 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:09.927666 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5082229b-d8db-4f4c-b177-03d0887e2c42 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:09.928162 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5082229b-d8db-4f4c-b177-03d0887e2c42 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:09.928592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5082229b-d8db-4f4c-b177-03d0887e2c42 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:09.933472 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5082229b-d8db-4f4c-b177-03d0887e2c42 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:09.934019 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5082229b-d8db-4f4c-b177-03d0887e2c42 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:09.934388 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5082229b-d8db-4f4c-b177-03d0887e2c42 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:09.939922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:10.138800 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e22c0805-d894-4275-88a4-202bcd17328f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:10.148870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e22c0805-d894-4275-88a4-202bcd17328f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.277985 Aug 05 07:15:10.149595 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 103/196] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:09 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:10.161309 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5082229b-d8db-4f4c-b177-03d0887e2c42 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:10.175771 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5082229b-d8db-4f4c-b177-03d0887e2c42 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.266859 Aug 05 07:15:10.176997 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 94/197] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:09 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:10.268605 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7fb8d358-9f6f-4837-9612-f6584b4d2a43 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:10.269256 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7fb8d358-9f6f-4837-9612-f6584b4d2a43 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:10.276100 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fb8d358-9f6f-4837-9612-f6584b4d2a43 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:10.277075 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fb8d358-9f6f-4837-9612-f6584b4d2a43 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:10.278059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fb8d358-9f6f-4837-9612-f6584b4d2a43 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:10.280327 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fb8d358-9f6f-4837-9612-f6584b4d2a43 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:10.281351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fb8d358-9f6f-4837-9612-f6584b4d2a43 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:10.281988 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fb8d358-9f6f-4837-9612-f6584b4d2a43 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:10.306928 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:10.467088 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7fb8d358-9f6f-4837-9612-f6584b4d2a43 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:10.477864 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7fb8d358-9f6f-4837-9612-f6584b4d2a43 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.214842 Aug 05 07:15:10.479095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 104/198] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:10 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:10.616236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7d9d4978-68cc-4bb2-90aa-ba57bd020bc9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:10.617520 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7d9d4978-68cc-4bb2-90aa-ba57bd020bc9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:10.623986 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d9d4978-68cc-4bb2-90aa-ba57bd020bc9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:10.624532 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d9d4978-68cc-4bb2-90aa-ba57bd020bc9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:10.625046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d9d4978-68cc-4bb2-90aa-ba57bd020bc9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:10.625792 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d9d4978-68cc-4bb2-90aa-ba57bd020bc9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:10.626296 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d9d4978-68cc-4bb2-90aa-ba57bd020bc9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:10.626771 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d9d4978-68cc-4bb2-90aa-ba57bd020bc9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:10.835050 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7d9d4978-68cc-4bb2-90aa-ba57bd020bc9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:10.844108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7d9d4978-68cc-4bb2-90aa-ba57bd020bc9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.233657 Aug 05 07:15:10.844689 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 95/199] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:10 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:11.173564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5e584e6e-6f31-46e3-ac48-742d496f472f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:11.174178 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5e584e6e-6f31-46e3-ac48-742d496f472f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:11.180457 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5e584e6e-6f31-46e3-ac48-742d496f472f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:11.180973 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5e584e6e-6f31-46e3-ac48-742d496f472f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:11.181411 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5e584e6e-6f31-46e3-ac48-742d496f472f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:11.182103 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5e584e6e-6f31-46e3-ac48-742d496f472f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:11.182554 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5e584e6e-6f31-46e3-ac48-742d496f472f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:11.182981 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5e584e6e-6f31-46e3-ac48-742d496f472f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:11.213346 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d0c29bc9-b151-4833-85b9-2b9f66679111 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:11.213977 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d0c29bc9-b151-4833-85b9-2b9f66679111 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:11.228059 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0c29bc9-b151-4833-85b9-2b9f66679111 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:11.228835 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0c29bc9-b151-4833-85b9-2b9f66679111 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:11.229525 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0c29bc9-b151-4833-85b9-2b9f66679111 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:11.230445 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0c29bc9-b151-4833-85b9-2b9f66679111 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:11.230864 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0c29bc9-b151-4833-85b9-2b9f66679111 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:11.231316 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0c29bc9-b151-4833-85b9-2b9f66679111 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:11.381404 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5e584e6e-6f31-46e3-ac48-742d496f472f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:11.394658 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5e584e6e-6f31-46e3-ac48-742d496f472f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1322 microversion: 2.1 time: 0.224865 Aug 05 07:15:11.396777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 105/200] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:11 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:11.471342 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d0c29bc9-b151-4833-85b9-2b9f66679111 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:11.487174 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d0c29bc9-b151-4833-85b9-2b9f66679111 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.276670 Aug 05 07:15:11.488051 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 96/201] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:11 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:11.506714 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-817bb1bc-d322-4e98-bfcd-8d78bee38ec5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:11.507991 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-817bb1bc-d322-4e98-bfcd-8d78bee38ec5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:11.516170 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-817bb1bc-d322-4e98-bfcd-8d78bee38ec5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:11.516854 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-817bb1bc-d322-4e98-bfcd-8d78bee38ec5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:11.517864 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-817bb1bc-d322-4e98-bfcd-8d78bee38ec5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:11.518349 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-817bb1bc-d322-4e98-bfcd-8d78bee38ec5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:11.519109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-817bb1bc-d322-4e98-bfcd-8d78bee38ec5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:11.519598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-817bb1bc-d322-4e98-bfcd-8d78bee38ec5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:11.714919 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-817bb1bc-d322-4e98-bfcd-8d78bee38ec5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:11.730106 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-817bb1bc-d322-4e98-bfcd-8d78bee38ec5 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.226015 Aug 05 07:15:11.733233 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 106/202] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:11 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:11.871588 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-278dddcf-2f69-40be-9bdf-4d9988aca898 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:11.873405 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-278dddcf-2f69-40be-9bdf-4d9988aca898 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:11.890717 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-278dddcf-2f69-40be-9bdf-4d9988aca898 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:11.892268 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-278dddcf-2f69-40be-9bdf-4d9988aca898 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:11.893066 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-278dddcf-2f69-40be-9bdf-4d9988aca898 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:11.894754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-278dddcf-2f69-40be-9bdf-4d9988aca898 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:11.895503 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-278dddcf-2f69-40be-9bdf-4d9988aca898 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:11.896081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-278dddcf-2f69-40be-9bdf-4d9988aca898 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:12.287986 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-278dddcf-2f69-40be-9bdf-4d9988aca898 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:12.297424 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-278dddcf-2f69-40be-9bdf-4d9988aca898 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.433286 Aug 05 07:15:12.309868 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 97/203] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:11 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:12.419512 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e325f5ff-44ff-401e-ad0c-0180fd0c80d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:12.421552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e325f5ff-44ff-401e-ad0c-0180fd0c80d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:12.433092 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e325f5ff-44ff-401e-ad0c-0180fd0c80d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:12.434021 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e325f5ff-44ff-401e-ad0c-0180fd0c80d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:12.434725 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e325f5ff-44ff-401e-ad0c-0180fd0c80d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:12.435753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e325f5ff-44ff-401e-ad0c-0180fd0c80d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:12.436358 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e325f5ff-44ff-401e-ad0c-0180fd0c80d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:12.436956 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e325f5ff-44ff-401e-ad0c-0180fd0c80d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:12.513225 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4e85045e-606b-4f73-a717-f7d109865e58 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:12.513900 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4e85045e-606b-4f73-a717-f7d109865e58 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:12.523181 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e85045e-606b-4f73-a717-f7d109865e58 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:12.523686 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e85045e-606b-4f73-a717-f7d109865e58 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:12.524122 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e85045e-606b-4f73-a717-f7d109865e58 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:12.524837 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e85045e-606b-4f73-a717-f7d109865e58 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:12.525285 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e85045e-606b-4f73-a717-f7d109865e58 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:12.529294 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e85045e-606b-4f73-a717-f7d109865e58 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:12.722404 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4e85045e-606b-4f73-a717-f7d109865e58 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:12.737406 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4e85045e-606b-4f73-a717-f7d109865e58 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.232816 Aug 05 07:15:12.738303 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 98/204] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:12 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:12.756338 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e629d5b3-c847-42f7-ac1b-bb3bf9bc45b8 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:12.757311 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e629d5b3-c847-42f7-ac1b-bb3bf9bc45b8 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:12.770724 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e629d5b3-c847-42f7-ac1b-bb3bf9bc45b8 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:12.772130 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e629d5b3-c847-42f7-ac1b-bb3bf9bc45b8 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:12.773183 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e629d5b3-c847-42f7-ac1b-bb3bf9bc45b8 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:12.774504 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e629d5b3-c847-42f7-ac1b-bb3bf9bc45b8 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:12.775852 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e629d5b3-c847-42f7-ac1b-bb3bf9bc45b8 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:12.777677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e629d5b3-c847-42f7-ac1b-bb3bf9bc45b8 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:12.965280 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e325f5ff-44ff-401e-ad0c-0180fd0c80d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:12.975674 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e325f5ff-44ff-401e-ad0c-0180fd0c80d2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1516 microversion: 2.1 time: 0.562671 Aug 05 07:15:12.979109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 107/205] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:12 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1516 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:13.000446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1f7e75c0-dbb0-463c-8e1b-25046d1d834a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:13.003134 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1f7e75c0-dbb0-463c-8e1b-25046d1d834a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:13.016594 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f7e75c0-dbb0-463c-8e1b-25046d1d834a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:13.017441 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f7e75c0-dbb0-463c-8e1b-25046d1d834a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:13.018073 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f7e75c0-dbb0-463c-8e1b-25046d1d834a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:13.019130 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f7e75c0-dbb0-463c-8e1b-25046d1d834a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:13.029676 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f7e75c0-dbb0-463c-8e1b-25046d1d834a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:13.030483 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f7e75c0-dbb0-463c-8e1b-25046d1d834a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:13.092879 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e629d5b3-c847-42f7-ac1b-bb3bf9bc45b8 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:13.118260 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e629d5b3-c847-42f7-ac1b-bb3bf9bc45b8 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.366941 Aug 05 07:15:13.121375 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 99/206] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:12 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:13.159985 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-1f7e75c0-dbb0-463c-8e1b-25046d1d834a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lazy-loading 'flavor' on Instance uuid c8759583-2a52-42ed-a5e0-c72a7000b211 {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:15:13.322298 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5092a5d5-2244-479d-b083-6e0c0ad7d758 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:13.323490 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5092a5d5-2244-479d-b083-6e0c0ad7d758 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:13.345042 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5092a5d5-2244-479d-b083-6e0c0ad7d758 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:13.345850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5092a5d5-2244-479d-b083-6e0c0ad7d758 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:13.346422 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5092a5d5-2244-479d-b083-6e0c0ad7d758 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:13.347589 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5092a5d5-2244-479d-b083-6e0c0ad7d758 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:13.349107 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5092a5d5-2244-479d-b083-6e0c0ad7d758 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:13.349687 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5092a5d5-2244-479d-b083-6e0c0ad7d758 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:13.439436 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1f7e75c0-dbb0-463c-8e1b-25046d1d834a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "POST /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211/action" status: 200 len: 32 microversion: 2.1 time: 0.441155 Aug 05 07:15:13.440755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 108/207] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:15:12 2022] POST /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211/action => generated 32 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 07:15:13.454026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-06750b01-fe8a-4871-8fcb-5d025b290445 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:13.456612 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-06750b01-fe8a-4871-8fcb-5d025b290445 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:13.464723 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-06750b01-fe8a-4871-8fcb-5d025b290445 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:13.465664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-06750b01-fe8a-4871-8fcb-5d025b290445 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:13.466361 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-06750b01-fe8a-4871-8fcb-5d025b290445 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:13.467219 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-06750b01-fe8a-4871-8fcb-5d025b290445 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:13.467862 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-06750b01-fe8a-4871-8fcb-5d025b290445 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:13.468432 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-06750b01-fe8a-4871-8fcb-5d025b290445 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:13.658104 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5092a5d5-2244-479d-b083-6e0c0ad7d758 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:13.668091 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-06750b01-fe8a-4871-8fcb-5d025b290445 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:13.679275 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5092a5d5-2244-479d-b083-6e0c0ad7d758 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.362688 Aug 05 07:15:13.679879 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 100/208] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:13 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:13.683672 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-06750b01-fe8a-4871-8fcb-5d025b290445 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.234005 Aug 05 07:15:13.684256 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 109/209] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:13 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:13.760664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fd41eaf2-0a8e-4896-be15-2b1aaa7a66cb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:13.762109 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fd41eaf2-0a8e-4896-be15-2b1aaa7a66cb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:13.771229 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd41eaf2-0a8e-4896-be15-2b1aaa7a66cb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:13.772366 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd41eaf2-0a8e-4896-be15-2b1aaa7a66cb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:13.773150 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd41eaf2-0a8e-4896-be15-2b1aaa7a66cb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:13.773883 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd41eaf2-0a8e-4896-be15-2b1aaa7a66cb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:13.777610 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd41eaf2-0a8e-4896-be15-2b1aaa7a66cb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:13.778283 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd41eaf2-0a8e-4896-be15-2b1aaa7a66cb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:14.067332 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fd41eaf2-0a8e-4896-be15-2b1aaa7a66cb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:14.081420 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fd41eaf2-0a8e-4896-be15-2b1aaa7a66cb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.326209 Aug 05 07:15:14.084181 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 101/210] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:13 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:14.143437 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-bfc31851-a950-41dc-a847-85caf1dfc26f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:14.144728 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-bfc31851-a950-41dc-a847-85caf1dfc26f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:14.160563 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bfc31851-a950-41dc-a847-85caf1dfc26f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:14.161475 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bfc31851-a950-41dc-a847-85caf1dfc26f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:14.162153 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bfc31851-a950-41dc-a847-85caf1dfc26f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:14.163097 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bfc31851-a950-41dc-a847-85caf1dfc26f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:14.165284 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bfc31851-a950-41dc-a847-85caf1dfc26f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:14.166000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bfc31851-a950-41dc-a847-85caf1dfc26f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:14.481435 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-bfc31851-a950-41dc-a847-85caf1dfc26f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:14.492382 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-bfc31851-a950-41dc-a847-85caf1dfc26f tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.353451 Aug 05 07:15:14.495853 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 110/211] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:14 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:14.614724 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-fb531dc5-005c-4db9-902f-b08538cd3cae req-a20937c6-590d-4ae7-9fef-5a91c099f516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c3c22d-3c48-4d1b-8ee9-29c1e3268147", "name": "network-vif-plugged", "status": "completed", "tag": "27f2f9c3-a397-478f-89d5-adb7b9c5e4af"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:14.683016 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-fb531dc5-005c-4db9-902f-b08538cd3cae req-a20937c6-590d-4ae7-9fef-5a91c099f516 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:14.683765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-fb531dc5-005c-4db9-902f-b08538cd3cae req-a20937c6-590d-4ae7-9fef-5a91c099f516 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:14.686009 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-fb531dc5-005c-4db9-902f-b08538cd3cae req-a20937c6-590d-4ae7-9fef-5a91c099f516 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:14.702754 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-34dd4f32-af3f-4496-a7a1-01eb184fc614 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:14.703369 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-34dd4f32-af3f-4496-a7a1-01eb184fc614 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:14.734107 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-fb531dc5-005c-4db9-902f-b08538cd3cae req-a20937c6-590d-4ae7-9fef-5a91c099f516 service nova] Creating event network-vif-plugged:27f2f9c3-a397-478f-89d5-adb7b9c5e4af for instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 on hv-cinder-85200 Aug 05 07:15:14.734527 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34dd4f32-af3f-4496-a7a1-01eb184fc614 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:14.735033 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34dd4f32-af3f-4496-a7a1-01eb184fc614 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:14.735469 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34dd4f32-af3f-4496-a7a1-01eb184fc614 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:14.736182 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34dd4f32-af3f-4496-a7a1-01eb184fc614 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:14.736627 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34dd4f32-af3f-4496-a7a1-01eb184fc614 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:14.737071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34dd4f32-af3f-4496-a7a1-01eb184fc614 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:14.742548 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-fb531dc5-005c-4db9-902f-b08538cd3cae req-a20937c6-590d-4ae7-9fef-5a91c099f516 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145240 Aug 05 07:15:14.748654 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 102/212] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:15:14.756793 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c49b2498-1ffd-491c-aa51-e50cc5e3641a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:14.757891 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c49b2498-1ffd-491c-aa51-e50cc5e3641a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:14.768280 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c49b2498-1ffd-491c-aa51-e50cc5e3641a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:14.769662 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c49b2498-1ffd-491c-aa51-e50cc5e3641a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:14.770426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c49b2498-1ffd-491c-aa51-e50cc5e3641a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:14.771598 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c49b2498-1ffd-491c-aa51-e50cc5e3641a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:14.772516 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c49b2498-1ffd-491c-aa51-e50cc5e3641a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:14.773222 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c49b2498-1ffd-491c-aa51-e50cc5e3641a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:14.997226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-34dd4f32-af3f-4496-a7a1-01eb184fc614 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:15.029258 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-34dd4f32-af3f-4496-a7a1-01eb184fc614 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.330085 Aug 05 07:15:15.030064 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 111/213] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:14 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:15.108827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9e019ccf-2476-4942-a42a-8d6c5bf8416a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:15.108827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9e019ccf-2476-4942-a42a-8d6c5bf8416a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:15.121737 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9e019ccf-2476-4942-a42a-8d6c5bf8416a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:15.122350 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9e019ccf-2476-4942-a42a-8d6c5bf8416a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:15.122981 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9e019ccf-2476-4942-a42a-8d6c5bf8416a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:15.124032 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9e019ccf-2476-4942-a42a-8d6c5bf8416a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:15.124721 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9e019ccf-2476-4942-a42a-8d6c5bf8416a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:15.125384 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9e019ccf-2476-4942-a42a-8d6c5bf8416a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:15.161393 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c49b2498-1ffd-491c-aa51-e50cc5e3641a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:15.171645 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c49b2498-1ffd-491c-aa51-e50cc5e3641a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.421252 Aug 05 07:15:15.173704 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 103/214] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:14 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:15.352534 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9e019ccf-2476-4942-a42a-8d6c5bf8416a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:15.365292 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9e019ccf-2476-4942-a42a-8d6c5bf8416a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.264978 Aug 05 07:15:15.384524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 112/215] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:15 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:15.514360 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4f6d0ac6-fbde-4b62-8b73-2fb8ff1b9641 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:15.514979 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4f6d0ac6-fbde-4b62-8b73-2fb8ff1b9641 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:15.522084 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f6d0ac6-fbde-4b62-8b73-2fb8ff1b9641 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:15.522695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f6d0ac6-fbde-4b62-8b73-2fb8ff1b9641 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:15.523134 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f6d0ac6-fbde-4b62-8b73-2fb8ff1b9641 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:15.523848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f6d0ac6-fbde-4b62-8b73-2fb8ff1b9641 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:15.524418 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f6d0ac6-fbde-4b62-8b73-2fb8ff1b9641 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:15.524844 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f6d0ac6-fbde-4b62-8b73-2fb8ff1b9641 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:15.754437 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4f6d0ac6-fbde-4b62-8b73-2fb8ff1b9641 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:15.765045 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4f6d0ac6-fbde-4b62-8b73-2fb8ff1b9641 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1315 microversion: 2.1 time: 0.255692 Aug 05 07:15:15.766128 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 104/216] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:15 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:16.054647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ef95f9bb-3545-4d3f-be88-447559c47516 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:16.055939 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ef95f9bb-3545-4d3f-be88-447559c47516 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:16.067891 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef95f9bb-3545-4d3f-be88-447559c47516 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:16.069486 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef95f9bb-3545-4d3f-be88-447559c47516 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:16.070818 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef95f9bb-3545-4d3f-be88-447559c47516 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:16.071955 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef95f9bb-3545-4d3f-be88-447559c47516 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:16.072562 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef95f9bb-3545-4d3f-be88-447559c47516 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:16.073339 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef95f9bb-3545-4d3f-be88-447559c47516 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:16.199033 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2065b0a2-a9ac-4b49-ac39-12faa422c54a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:16.199721 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2065b0a2-a9ac-4b49-ac39-12faa422c54a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:16.206877 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2065b0a2-a9ac-4b49-ac39-12faa422c54a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:16.212722 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2065b0a2-a9ac-4b49-ac39-12faa422c54a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:16.213271 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2065b0a2-a9ac-4b49-ac39-12faa422c54a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:16.214103 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2065b0a2-a9ac-4b49-ac39-12faa422c54a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:16.214634 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2065b0a2-a9ac-4b49-ac39-12faa422c54a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:16.215940 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2065b0a2-a9ac-4b49-ac39-12faa422c54a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:16.560454 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ef95f9bb-3545-4d3f-be88-447559c47516 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:16.574552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ef95f9bb-3545-4d3f-be88-447559c47516 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.523686 Aug 05 07:15:16.575754 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 113/217] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:16 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:16.581476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b4a564a5-8c2c-4324-a32c-8b6041bdff8f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:16.583075 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b4a564a5-8c2c-4324-a32c-8b6041bdff8f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:16.591935 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b4a564a5-8c2c-4324-a32c-8b6041bdff8f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:16.592804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b4a564a5-8c2c-4324-a32c-8b6041bdff8f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:16.593618 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b4a564a5-8c2c-4324-a32c-8b6041bdff8f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:16.594758 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b4a564a5-8c2c-4324-a32c-8b6041bdff8f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:16.595784 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b4a564a5-8c2c-4324-a32c-8b6041bdff8f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:16.596429 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b4a564a5-8c2c-4324-a32c-8b6041bdff8f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:16.820202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b4a564a5-8c2c-4324-a32c-8b6041bdff8f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:16.832456 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b4a564a5-8c2c-4324-a32c-8b6041bdff8f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.253484 Aug 05 07:15:16.833884 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 114/218] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:16 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:16.840109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4f505078-37af-4b86-a3fb-8a75d7896dc6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:16.841201 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4f505078-37af-4b86-a3fb-8a75d7896dc6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:16.842409 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2065b0a2-a9ac-4b49-ac39-12faa422c54a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:16.850481 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f505078-37af-4b86-a3fb-8a75d7896dc6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:16.851623 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f505078-37af-4b86-a3fb-8a75d7896dc6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:16.852502 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f505078-37af-4b86-a3fb-8a75d7896dc6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:16.853630 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2065b0a2-a9ac-4b49-ac39-12faa422c54a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.661184 Aug 05 07:15:16.854019 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f505078-37af-4b86-a3fb-8a75d7896dc6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:16.854215 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 105/219] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:16 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:16.854914 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f505078-37af-4b86-a3fb-8a75d7896dc6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:16.855220 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f505078-37af-4b86-a3fb-8a75d7896dc6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:17.026210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4f505078-37af-4b86-a3fb-8a75d7896dc6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:17.038386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4f505078-37af-4b86-a3fb-8a75d7896dc6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1503 microversion: 2.1 time: 0.202871 Aug 05 07:15:17.054922 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 115/220] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:16 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:17.597328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5e2ba626-7bef-4955-8c36-def726a882e6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:17.598273 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5e2ba626-7bef-4955-8c36-def726a882e6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:17.612245 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e2ba626-7bef-4955-8c36-def726a882e6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:17.612644 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e2ba626-7bef-4955-8c36-def726a882e6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:17.613278 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e2ba626-7bef-4955-8c36-def726a882e6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:17.614150 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e2ba626-7bef-4955-8c36-def726a882e6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:17.614752 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e2ba626-7bef-4955-8c36-def726a882e6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:17.615662 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e2ba626-7bef-4955-8c36-def726a882e6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:17.817584 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5e2ba626-7bef-4955-8c36-def726a882e6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:17.826324 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5e2ba626-7bef-4955-8c36-def726a882e6 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.233122 Aug 05 07:15:17.829569 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 106/221] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:17 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:17.855620 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3ccd08f0-f20b-4b1f-8d5d-66baa6bbe484 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:17.856610 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3ccd08f0-f20b-4b1f-8d5d-66baa6bbe484 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:17.858860 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:17.874278 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b9c57c7a-3164-4fdc-86d5-3187be953ff2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:17.875128 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b9c57c7a-3164-4fdc-86d5-3187be953ff2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:17.882387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3ccd08f0-f20b-4b1f-8d5d-66baa6bbe484 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:17.886647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3ccd08f0-f20b-4b1f-8d5d-66baa6bbe484 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:17.887841 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3ccd08f0-f20b-4b1f-8d5d-66baa6bbe484 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:17.888396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9c57c7a-3164-4fdc-86d5-3187be953ff2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:17.889524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3ccd08f0-f20b-4b1f-8d5d-66baa6bbe484 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:17.890496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3ccd08f0-f20b-4b1f-8d5d-66baa6bbe484 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:17.890620 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9c57c7a-3164-4fdc-86d5-3187be953ff2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:17.891229 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9c57c7a-3164-4fdc-86d5-3187be953ff2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:17.892455 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9c57c7a-3164-4fdc-86d5-3187be953ff2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:17.893137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3ccd08f0-f20b-4b1f-8d5d-66baa6bbe484 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:17.893378 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9c57c7a-3164-4fdc-86d5-3187be953ff2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:17.893987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9c57c7a-3164-4fdc-86d5-3187be953ff2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:18.264798 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3ccd08f0-f20b-4b1f-8d5d-66baa6bbe484 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:18.274180 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3ccd08f0-f20b-4b1f-8d5d-66baa6bbe484 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1367 microversion: 2.1 time: 0.422815 Aug 05 07:15:18.275282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 116/222] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:17 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:18.278055 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b9c57c7a-3164-4fdc-86d5-3187be953ff2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:18.287291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b9c57c7a-3164-4fdc-86d5-3187be953ff2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.417225 Aug 05 07:15:18.287884 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 107/223] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:17 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:18.416245 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-f3f78fa6-9ac9-40e4-9317-c657c5a48e91 req-2f31b763-ae98-4061-8623-75efda66d397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf59ded-e598-4ac7-ba2e-9a3c2210d007", "name": "network-vif-plugged", "status": "completed", "tag": "ede42d65-04d0-40ad-8a04-8c635128bf7f"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:18.430524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-f3f78fa6-9ac9-40e4-9317-c657c5a48e91 req-2f31b763-ae98-4061-8623-75efda66d397 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:18.431385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-f3f78fa6-9ac9-40e4-9317-c657c5a48e91 req-2f31b763-ae98-4061-8623-75efda66d397 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:18.431817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-f3f78fa6-9ac9-40e4-9317-c657c5a48e91 req-2f31b763-ae98-4061-8623-75efda66d397 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:18.446010 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-f3f78fa6-9ac9-40e4-9317-c657c5a48e91 req-2f31b763-ae98-4061-8623-75efda66d397 service nova] Creating event network-vif-plugged:ede42d65-04d0-40ad-8a04-8c635128bf7f for instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 on hv-cinder-85200 Aug 05 07:15:18.451972 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-f3f78fa6-9ac9-40e4-9317-c657c5a48e91 req-2f31b763-ae98-4061-8623-75efda66d397 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039951 Aug 05 07:15:18.452782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 117/224] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:15:18.748769 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ae509f66-5d2b-4cd8-9d2d-236edde3d760 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b374797d-5bec-429b-a08f-d5a67c4d5dba"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:18.753203 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ae509f66-5d2b-4cd8-9d2d-236edde3d760 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:18.763226 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae509f66-5d2b-4cd8-9d2d-236edde3d760 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:18.763874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae509f66-5d2b-4cd8-9d2d-236edde3d760 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:18.764408 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae509f66-5d2b-4cd8-9d2d-236edde3d760 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:18.765245 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae509f66-5d2b-4cd8-9d2d-236edde3d760 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:18.765824 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae509f66-5d2b-4cd8-9d2d-236edde3d760 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:18.766343 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae509f66-5d2b-4cd8-9d2d-236edde3d760 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:18.850955 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2ccbfadb-b4ba-48f3-a0b9-fa5564ee5000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:18.851679 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2ccbfadb-b4ba-48f3-a0b9-fa5564ee5000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:18.859580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2ccbfadb-b4ba-48f3-a0b9-fa5564ee5000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:18.860060 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2ccbfadb-b4ba-48f3-a0b9-fa5564ee5000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:18.860669 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2ccbfadb-b4ba-48f3-a0b9-fa5564ee5000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:18.861410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2ccbfadb-b4ba-48f3-a0b9-fa5564ee5000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:18.861861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2ccbfadb-b4ba-48f3-a0b9-fa5564ee5000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:18.862276 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2ccbfadb-b4ba-48f3-a0b9-fa5564ee5000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:19.053091 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2ccbfadb-b4ba-48f3-a0b9-fa5564ee5000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:19.067482 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2ccbfadb-b4ba-48f3-a0b9-fa5564ee5000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.220837 Aug 05 07:15:19.068594 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 118/225] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:18 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:19.307588 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9855001b-14fd-4fc3-be8f-28036704dd2c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:19.308334 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9855001b-14fd-4fc3-be8f-28036704dd2c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:19.315649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9855001b-14fd-4fc3-be8f-28036704dd2c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:19.317193 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9855001b-14fd-4fc3-be8f-28036704dd2c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:19.317610 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9855001b-14fd-4fc3-be8f-28036704dd2c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:19.318393 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9855001b-14fd-4fc3-be8f-28036704dd2c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:19.318841 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9855001b-14fd-4fc3-be8f-28036704dd2c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:19.319374 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9855001b-14fd-4fc3-be8f-28036704dd2c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:19.491405 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9855001b-14fd-4fc3-be8f-28036704dd2c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:19.495543 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:19.501358 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9855001b-14fd-4fc3-be8f-28036704dd2c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1556 microversion: 2.1 time: 0.200957 Aug 05 07:15:19.502352 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 119/226] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:19 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1556 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:19.507472 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-732dacfb-4cde-467e-bed2-4dc727733dba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:19.508627 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-732dacfb-4cde-467e-bed2-4dc727733dba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:19.517457 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-732dacfb-4cde-467e-bed2-4dc727733dba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:19.518248 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-732dacfb-4cde-467e-bed2-4dc727733dba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:19.520241 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-732dacfb-4cde-467e-bed2-4dc727733dba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:19.521127 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-732dacfb-4cde-467e-bed2-4dc727733dba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:19.521768 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-732dacfb-4cde-467e-bed2-4dc727733dba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:19.522558 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-732dacfb-4cde-467e-bed2-4dc727733dba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:19.679492 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-732dacfb-4cde-467e-bed2-4dc727733dba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:19.693510 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-732dacfb-4cde-467e-bed2-4dc727733dba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.189877 Aug 05 07:15:19.694107 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 120/227] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:19 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:19.701728 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-bbd4d273-fcd0-42e2-b01a-0b862fced009 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:19.702221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-bbd4d273-fcd0-42e2-b01a-0b862fced009 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:19.708647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bbd4d273-fcd0-42e2-b01a-0b862fced009 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:19.709165 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bbd4d273-fcd0-42e2-b01a-0b862fced009 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:19.710091 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bbd4d273-fcd0-42e2-b01a-0b862fced009 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:19.710763 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bbd4d273-fcd0-42e2-b01a-0b862fced009 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:19.711218 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bbd4d273-fcd0-42e2-b01a-0b862fced009 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:19.711640 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bbd4d273-fcd0-42e2-b01a-0b862fced009 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:19.802779 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-bbd4d273-fcd0-42e2-b01a-0b862fced009 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107196 Aug 05 07:15:19.803969 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 121/228] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 5 07:15:19 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:15:20.090125 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4d5b1b9a-c8ed-4adb-b511-4486b5583763 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:20.090955 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4d5b1b9a-c8ed-4adb-b511-4486b5583763 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:20.097552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4d5b1b9a-c8ed-4adb-b511-4486b5583763 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:20.098130 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4d5b1b9a-c8ed-4adb-b511-4486b5583763 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:20.098613 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4d5b1b9a-c8ed-4adb-b511-4486b5583763 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:20.099768 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4d5b1b9a-c8ed-4adb-b511-4486b5583763 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:20.100423 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4d5b1b9a-c8ed-4adb-b511-4486b5583763 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:20.101079 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4d5b1b9a-c8ed-4adb-b511-4486b5583763 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:20.247040 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4d5b1b9a-c8ed-4adb-b511-4486b5583763 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:20.263622 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4d5b1b9a-c8ed-4adb-b511-4486b5583763 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.177937 Aug 05 07:15:20.266222 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 122/229] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:20 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:20.715181 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-beba9abd-233c-48aa-b09e-8f5276e7b54c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:20.716690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-beba9abd-233c-48aa-b09e-8f5276e7b54c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:20.725712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-beba9abd-233c-48aa-b09e-8f5276e7b54c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:20.726601 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-beba9abd-233c-48aa-b09e-8f5276e7b54c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:20.727315 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-beba9abd-233c-48aa-b09e-8f5276e7b54c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:20.728870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-beba9abd-233c-48aa-b09e-8f5276e7b54c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:20.730002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-beba9abd-233c-48aa-b09e-8f5276e7b54c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:20.731005 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-beba9abd-233c-48aa-b09e-8f5276e7b54c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:20.852850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ae509f66-5d2b-4cd8-9d2d-236edde3d760 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "POST /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.110780 Aug 05 07:15:20.862515 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 108/230] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:15:18 2022] POST /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706/os-volume_attachments => generated 194 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:15:21.095647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-beba9abd-233c-48aa-b09e-8f5276e7b54c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:21.108877 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-beba9abd-233c-48aa-b09e-8f5276e7b54c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.397404 Aug 05 07:15:21.125208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 123/231] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:20 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:21.274186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-8be28755-5a7e-414c-867c-76abe4d81145 req-ffc2a1e1-30a6-4475-9ba8-36e9982fee1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c3c22d-3c48-4d1b-8ee9-29c1e3268147", "tag": "27f2f9c3-a397-478f-89d5-adb7b9c5e4af"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:21.289599 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2a19ebb6-ae36-4380-bae8-0130ad5f53f4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:21.290333 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2a19ebb6-ae36-4380-bae8-0130ad5f53f4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:21.291111 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-8be28755-5a7e-414c-867c-76abe4d81145 req-ffc2a1e1-30a6-4475-9ba8-36e9982fee1c service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:21.291586 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-8be28755-5a7e-414c-867c-76abe4d81145 req-ffc2a1e1-30a6-4475-9ba8-36e9982fee1c service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:21.292008 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-8be28755-5a7e-414c-867c-76abe4d81145 req-ffc2a1e1-30a6-4475-9ba8-36e9982fee1c service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:21.308424 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2a19ebb6-ae36-4380-bae8-0130ad5f53f4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:21.309152 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2a19ebb6-ae36-4380-bae8-0130ad5f53f4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:21.309748 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2a19ebb6-ae36-4380-bae8-0130ad5f53f4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:21.310517 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2a19ebb6-ae36-4380-bae8-0130ad5f53f4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:21.311138 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2a19ebb6-ae36-4380-bae8-0130ad5f53f4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:21.311862 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2a19ebb6-ae36-4380-bae8-0130ad5f53f4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:21.317614 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-8be28755-5a7e-414c-867c-76abe4d81145 req-ffc2a1e1-30a6-4475-9ba8-36e9982fee1c service nova] Creating event network-changed:27f2f9c3-a397-478f-89d5-adb7b9c5e4af for instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 on hv-cinder-85200 Aug 05 07:15:21.328116 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-8be28755-5a7e-414c-867c-76abe4d81145 req-ffc2a1e1-30a6-4475-9ba8-36e9982fee1c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057735 Aug 05 07:15:21.333393 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 109/232] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:15:21.536155 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2a19ebb6-ae36-4380-bae8-0130ad5f53f4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:21.545407 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2a19ebb6-ae36-4380-bae8-0130ad5f53f4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1364 microversion: 2.1 time: 0.260651 Aug 05 07:15:21.546606 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 124/233] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:21 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:22.133167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-731ed4b1-fed1-41c6-8f21-326c07104c54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:22.133876 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-731ed4b1-fed1-41c6-8f21-326c07104c54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:22.141528 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-731ed4b1-fed1-41c6-8f21-326c07104c54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:22.142012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-731ed4b1-fed1-41c6-8f21-326c07104c54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:22.142443 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-731ed4b1-fed1-41c6-8f21-326c07104c54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:22.143137 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-731ed4b1-fed1-41c6-8f21-326c07104c54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:22.143588 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-731ed4b1-fed1-41c6-8f21-326c07104c54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:22.144007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-731ed4b1-fed1-41c6-8f21-326c07104c54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:22.567598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2af90db7-11bc-4125-a399-8ea1e9c084ae tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:22.569061 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2af90db7-11bc-4125-a399-8ea1e9c084ae tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:22.589454 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2af90db7-11bc-4125-a399-8ea1e9c084ae tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:22.590172 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2af90db7-11bc-4125-a399-8ea1e9c084ae tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:22.590912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2af90db7-11bc-4125-a399-8ea1e9c084ae tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:22.592048 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2af90db7-11bc-4125-a399-8ea1e9c084ae tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:22.593365 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2af90db7-11bc-4125-a399-8ea1e9c084ae tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:22.593949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2af90db7-11bc-4125-a399-8ea1e9c084ae tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:22.631487 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-731ed4b1-fed1-41c6-8f21-326c07104c54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:22.636329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:22.648165 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-731ed4b1-fed1-41c6-8f21-326c07104c54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.519876 Aug 05 07:15:22.655778 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 110/234] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:22 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:22.824834 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2af90db7-11bc-4125-a399-8ea1e9c084ae tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:22.842537 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2af90db7-11bc-4125-a399-8ea1e9c084ae tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1550 microversion: 2.1 time: 0.279282 Aug 05 07:15:22.843566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 125/235] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:22 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1550 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:22.865822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0a118549-d8ee-424d-b8a5-6fc1424a06f8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:22.866337 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0a118549-d8ee-424d-b8a5-6fc1424a06f8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:22.875554 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a118549-d8ee-424d-b8a5-6fc1424a06f8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:22.876050 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a118549-d8ee-424d-b8a5-6fc1424a06f8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:22.876492 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a118549-d8ee-424d-b8a5-6fc1424a06f8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:22.877245 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a118549-d8ee-424d-b8a5-6fc1424a06f8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:22.877700 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a118549-d8ee-424d-b8a5-6fc1424a06f8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:22.878124 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a118549-d8ee-424d-b8a5-6fc1424a06f8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:22.987710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0a118549-d8ee-424d-b8a5-6fc1424a06f8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127141 Aug 05 07:15:22.988489 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 111/236] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 5 07:15:22 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:15:23.689121 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1664355b-9519-41a4-88fa-d74145f339e9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:23.694153 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1664355b-9519-41a4-88fa-d74145f339e9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:23.743425 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1664355b-9519-41a4-88fa-d74145f339e9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:23.743937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1664355b-9519-41a4-88fa-d74145f339e9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:23.744388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1664355b-9519-41a4-88fa-d74145f339e9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:23.748815 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1664355b-9519-41a4-88fa-d74145f339e9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:23.749697 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1664355b-9519-41a4-88fa-d74145f339e9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:23.751637 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1664355b-9519-41a4-88fa-d74145f339e9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:24.383304 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1664355b-9519-41a4-88fa-d74145f339e9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:24.392987 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1664355b-9519-41a4-88fa-d74145f339e9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.716643 Aug 05 07:15:24.402694 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 126/237] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:23 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:24.998712 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-06eec4d2-35bf-46bd-88db-906af31f57ea req-d062da7b-3151-4c5b-89a0-7ece375309dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acf59ded-e598-4ac7-ba2e-9a3c2210d007", "tag": "ede42d65-04d0-40ad-8a04-8c635128bf7f"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:25.014223 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-06eec4d2-35bf-46bd-88db-906af31f57ea req-d062da7b-3151-4c5b-89a0-7ece375309dc service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:25.014701 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-06eec4d2-35bf-46bd-88db-906af31f57ea req-d062da7b-3151-4c5b-89a0-7ece375309dc service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:25.015130 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-06eec4d2-35bf-46bd-88db-906af31f57ea req-d062da7b-3151-4c5b-89a0-7ece375309dc service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:25.030769 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-06eec4d2-35bf-46bd-88db-906af31f57ea req-d062da7b-3151-4c5b-89a0-7ece375309dc service nova] Creating event network-changed:ede42d65-04d0-40ad-8a04-8c635128bf7f for instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 on hv-cinder-85200 Aug 05 07:15:25.036625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-06eec4d2-35bf-46bd-88db-906af31f57ea req-d062da7b-3151-4c5b-89a0-7ece375309dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042519 Aug 05 07:15:25.041275 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 112/238] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:15:25.468441 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-09396a60-44da-488d-a941-a6d5c702df99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:25.469888 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-09396a60-44da-488d-a941-a6d5c702df99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:25.506472 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-09396a60-44da-488d-a941-a6d5c702df99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:25.507850 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-09396a60-44da-488d-a941-a6d5c702df99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:25.508295 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-09396a60-44da-488d-a941-a6d5c702df99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:25.509051 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-09396a60-44da-488d-a941-a6d5c702df99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:25.520021 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-09396a60-44da-488d-a941-a6d5c702df99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:25.520846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-09396a60-44da-488d-a941-a6d5c702df99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:25.820021 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-09396a60-44da-488d-a941-a6d5c702df99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:25.839244 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-09396a60-44da-488d-a941-a6d5c702df99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.391267 Aug 05 07:15:25.847796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 127/239] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:25 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:26.860952 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-456a9bc1-2116-4c66-af05-4e6c6895cab8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:26.862282 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-456a9bc1-2116-4c66-af05-4e6c6895cab8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:26.869859 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-456a9bc1-2116-4c66-af05-4e6c6895cab8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:26.870834 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-456a9bc1-2116-4c66-af05-4e6c6895cab8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:26.871750 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-456a9bc1-2116-4c66-af05-4e6c6895cab8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:26.872735 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-456a9bc1-2116-4c66-af05-4e6c6895cab8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:26.873574 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-456a9bc1-2116-4c66-af05-4e6c6895cab8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:26.874281 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-456a9bc1-2116-4c66-af05-4e6c6895cab8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:27.021960 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-456a9bc1-2116-4c66-af05-4e6c6895cab8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:27.033946 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-456a9bc1-2116-4c66-af05-4e6c6895cab8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.176821 Aug 05 07:15:27.034708 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 113/240] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:26 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:28.067964 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0cb7410d-493b-4b89-b68d-5147d0b97615 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:28.069792 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0cb7410d-493b-4b89-b68d-5147d0b97615 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:28.079976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0cb7410d-493b-4b89-b68d-5147d0b97615 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:28.080458 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0cb7410d-493b-4b89-b68d-5147d0b97615 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:28.081293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0cb7410d-493b-4b89-b68d-5147d0b97615 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:28.082161 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0cb7410d-493b-4b89-b68d-5147d0b97615 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:28.082758 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0cb7410d-493b-4b89-b68d-5147d0b97615 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:28.083326 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0cb7410d-493b-4b89-b68d-5147d0b97615 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:28.236933 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0cb7410d-493b-4b89-b68d-5147d0b97615 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:28.244445 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0cb7410d-493b-4b89-b68d-5147d0b97615 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.182805 Aug 05 07:15:28.266810 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 128/241] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:28 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:29.271594 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7edb559e-3f48-4954-86d2-a3924f8cdd2f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:29.272213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7edb559e-3f48-4954-86d2-a3924f8cdd2f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:29.292160 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7edb559e-3f48-4954-86d2-a3924f8cdd2f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:29.292768 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7edb559e-3f48-4954-86d2-a3924f8cdd2f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:29.293106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7edb559e-3f48-4954-86d2-a3924f8cdd2f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:29.293905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7edb559e-3f48-4954-86d2-a3924f8cdd2f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:29.294364 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7edb559e-3f48-4954-86d2-a3924f8cdd2f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:29.294788 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7edb559e-3f48-4954-86d2-a3924f8cdd2f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:29.502983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7edb559e-3f48-4954-86d2-a3924f8cdd2f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:29.510578 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7edb559e-3f48-4954-86d2-a3924f8cdd2f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.242817 Aug 05 07:15:29.511345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 114/242] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:29 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:30.532551 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1ce7554b-7030-4bb4-bcdd-5f4eb13ed71c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:30.533216 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1ce7554b-7030-4bb4-bcdd-5f4eb13ed71c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:30.542831 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1ce7554b-7030-4bb4-bcdd-5f4eb13ed71c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:30.543857 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1ce7554b-7030-4bb4-bcdd-5f4eb13ed71c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:30.544552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1ce7554b-7030-4bb4-bcdd-5f4eb13ed71c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:30.545581 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1ce7554b-7030-4bb4-bcdd-5f4eb13ed71c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:30.546332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1ce7554b-7030-4bb4-bcdd-5f4eb13ed71c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:30.547288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1ce7554b-7030-4bb4-bcdd-5f4eb13ed71c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:30.800052 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1ce7554b-7030-4bb4-bcdd-5f4eb13ed71c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:30.811571 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1ce7554b-7030-4bb4-bcdd-5f4eb13ed71c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.283436 Aug 05 07:15:30.812600 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 129/243] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:30 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:31.184399 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-11b9d1dd-8133-4da3-9e3d-4cabc79b643a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:31.185044 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-11b9d1dd-8133-4da3-9e3d-4cabc79b643a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:31.192746 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11b9d1dd-8133-4da3-9e3d-4cabc79b643a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:31.193532 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11b9d1dd-8133-4da3-9e3d-4cabc79b643a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:31.194142 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11b9d1dd-8133-4da3-9e3d-4cabc79b643a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:31.195078 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11b9d1dd-8133-4da3-9e3d-4cabc79b643a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:31.195596 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11b9d1dd-8133-4da3-9e3d-4cabc79b643a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:31.196214 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11b9d1dd-8133-4da3-9e3d-4cabc79b643a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:31.236166 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-11b9d1dd-8133-4da3-9e3d-4cabc79b643a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:15:31.359211 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-11b9d1dd-8133-4da3-9e3d-4cabc79b643a tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 204 len: 0 microversion: 2.1 time: 0.178599 Aug 05 07:15:31.360426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 115/244] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:15:31 2022] DELETE /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:15:31.369731 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3f142d06-a245-4948-929f-4c8e505dea81 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:31.370553 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3f142d06-a245-4948-929f-4c8e505dea81 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:31.377249 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f142d06-a245-4948-929f-4c8e505dea81 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:31.377752 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f142d06-a245-4948-929f-4c8e505dea81 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:31.378247 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f142d06-a245-4948-929f-4c8e505dea81 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:31.378982 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f142d06-a245-4948-929f-4c8e505dea81 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:31.379721 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f142d06-a245-4948-929f-4c8e505dea81 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:31.380616 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f142d06-a245-4948-929f-4c8e505dea81 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:31.556203 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3f142d06-a245-4948-929f-4c8e505dea81 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:31.568390 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3f142d06-a245-4948-929f-4c8e505dea81 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1555 microversion: 2.1 time: 0.202814 Aug 05 07:15:31.569107 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 130/245] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:31 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1555 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:31.832758 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4f83edbd-bb72-4e38-8ede-3ee08aa2ef02 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:31.833648 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4f83edbd-bb72-4e38-8ede-3ee08aa2ef02 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:31.842849 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f83edbd-bb72-4e38-8ede-3ee08aa2ef02 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:31.843350 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f83edbd-bb72-4e38-8ede-3ee08aa2ef02 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:31.843880 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f83edbd-bb72-4e38-8ede-3ee08aa2ef02 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:31.844570 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f83edbd-bb72-4e38-8ede-3ee08aa2ef02 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:31.845312 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f83edbd-bb72-4e38-8ede-3ee08aa2ef02 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:31.845743 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4f83edbd-bb72-4e38-8ede-3ee08aa2ef02 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:32.022404 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4f83edbd-bb72-4e38-8ede-3ee08aa2ef02 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:32.032427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4f83edbd-bb72-4e38-8ede-3ee08aa2ef02 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.204550 Aug 05 07:15:32.033235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 116/246] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:31 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:32.590409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0cd21ec5-7f16-4000-b075-970c4ccfe9f9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:32.591045 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0cd21ec5-7f16-4000-b075-970c4ccfe9f9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:32.598471 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0cd21ec5-7f16-4000-b075-970c4ccfe9f9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:32.598951 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0cd21ec5-7f16-4000-b075-970c4ccfe9f9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:32.599546 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0cd21ec5-7f16-4000-b075-970c4ccfe9f9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:32.600744 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0cd21ec5-7f16-4000-b075-970c4ccfe9f9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:32.601865 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0cd21ec5-7f16-4000-b075-970c4ccfe9f9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:32.602445 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0cd21ec5-7f16-4000-b075-970c4ccfe9f9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:32.782361 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0cd21ec5-7f16-4000-b075-970c4ccfe9f9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:32.791673 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0cd21ec5-7f16-4000-b075-970c4ccfe9f9 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1555 microversion: 2.1 time: 0.205628 Aug 05 07:15:32.792649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 131/247] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:32 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1555 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:33.052918 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-627a1bcf-4961-4c9c-b72b-ff5c25c9a7cf tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:33.054181 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-627a1bcf-4961-4c9c-b72b-ff5c25c9a7cf tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:33.062117 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-627a1bcf-4961-4c9c-b72b-ff5c25c9a7cf tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:33.062596 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-627a1bcf-4961-4c9c-b72b-ff5c25c9a7cf tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:33.063189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-627a1bcf-4961-4c9c-b72b-ff5c25c9a7cf tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:33.063883 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-627a1bcf-4961-4c9c-b72b-ff5c25c9a7cf tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:33.064474 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-627a1bcf-4961-4c9c-b72b-ff5c25c9a7cf tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:33.065072 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-627a1bcf-4961-4c9c-b72b-ff5c25c9a7cf tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:33.270478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-627a1bcf-4961-4c9c-b72b-ff5c25c9a7cf tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:33.279268 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-627a1bcf-4961-4c9c-b72b-ff5c25c9a7cf tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.230371 Aug 05 07:15:33.280087 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 117/248] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:33 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:33.813687 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-72ba63a3-dc21-45df-9772-463fdc3e08bc tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:33.814961 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-72ba63a3-dc21-45df-9772-463fdc3e08bc tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:33.821568 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-72ba63a3-dc21-45df-9772-463fdc3e08bc tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:33.822263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-72ba63a3-dc21-45df-9772-463fdc3e08bc tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:33.822840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-72ba63a3-dc21-45df-9772-463fdc3e08bc tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:33.823684 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-72ba63a3-dc21-45df-9772-463fdc3e08bc tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:33.824327 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-72ba63a3-dc21-45df-9772-463fdc3e08bc tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:33.824873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-72ba63a3-dc21-45df-9772-463fdc3e08bc tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:33.970298 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-72ba63a3-dc21-45df-9772-463fdc3e08bc tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:33.985990 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-72ba63a3-dc21-45df-9772-463fdc3e08bc tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1555 microversion: 2.1 time: 0.176251 Aug 05 07:15:33.986576 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 132/249] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:33 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:34.301886 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-149facbb-5c37-4557-90f1-d385c98e0fce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:34.302488 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-149facbb-5c37-4557-90f1-d385c98e0fce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:34.311776 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-149facbb-5c37-4557-90f1-d385c98e0fce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:34.312253 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-149facbb-5c37-4557-90f1-d385c98e0fce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:34.312935 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-149facbb-5c37-4557-90f1-d385c98e0fce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:34.315405 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-149facbb-5c37-4557-90f1-d385c98e0fce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:34.316100 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-149facbb-5c37-4557-90f1-d385c98e0fce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:34.317389 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-149facbb-5c37-4557-90f1-d385c98e0fce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:34.520808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-149facbb-5c37-4557-90f1-d385c98e0fce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:34.529696 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-149facbb-5c37-4557-90f1-d385c98e0fce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.231648 Aug 05 07:15:34.530616 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 118/250] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:34 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:34.770447 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-9f7dada9-9eb2-41e5-b7c6-8b42d56d28a7 req-862bf657-3d73-41a3-ba31-5aa35f9a9e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "076d8f98-2ac9-4f41-ad6b-41eaa1428706", "name": "network-vif-deleted", "tag": "a999eb01-1d23-4a60-b75e-1af095c98abc"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:34.786871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9f7dada9-9eb2-41e5-b7c6-8b42d56d28a7 req-862bf657-3d73-41a3-ba31-5aa35f9a9e0e service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:34.787626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9f7dada9-9eb2-41e5-b7c6-8b42d56d28a7 req-862bf657-3d73-41a3-ba31-5aa35f9a9e0e service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:34.788050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9f7dada9-9eb2-41e5-b7c6-8b42d56d28a7 req-862bf657-3d73-41a3-ba31-5aa35f9a9e0e service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:34.801060 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-9f7dada9-9eb2-41e5-b7c6-8b42d56d28a7 req-862bf657-3d73-41a3-ba31-5aa35f9a9e0e service nova] Creating event network-vif-deleted:a999eb01-1d23-4a60-b75e-1af095c98abc for instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 on hv-cinder-85200 Aug 05 07:15:34.811160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-9f7dada9-9eb2-41e5-b7c6-8b42d56d28a7 req-862bf657-3d73-41a3-ba31-5aa35f9a9e0e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044162 Aug 05 07:15:34.814664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 133/251] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:15:35.007787 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4b3d3997-12ca-4008-8e4b-a2f8cbf603c4 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:35.008355 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4b3d3997-12ca-4008-8e4b-a2f8cbf603c4 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:35.014820 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b3d3997-12ca-4008-8e4b-a2f8cbf603c4 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:35.015300 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b3d3997-12ca-4008-8e4b-a2f8cbf603c4 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:35.015739 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b3d3997-12ca-4008-8e4b-a2f8cbf603c4 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:35.016411 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b3d3997-12ca-4008-8e4b-a2f8cbf603c4 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:35.016855 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b3d3997-12ca-4008-8e4b-a2f8cbf603c4 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:35.017802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b3d3997-12ca-4008-8e4b-a2f8cbf603c4 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:35.103654 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4b3d3997-12ca-4008-8e4b-a2f8cbf603c4 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:35.112721 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4b3d3997-12ca-4008-8e4b-a2f8cbf603c4 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1346 microversion: 2.1 time: 0.108875 Aug 05 07:15:35.113917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 119/252] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:35 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:35.552160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b1f738d3-da65-4432-b6a8-854085c66d11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:35.552953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b1f738d3-da65-4432-b6a8-854085c66d11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:35.559406 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1f738d3-da65-4432-b6a8-854085c66d11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:35.559892 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1f738d3-da65-4432-b6a8-854085c66d11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:35.560320 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1f738d3-da65-4432-b6a8-854085c66d11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:35.561045 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1f738d3-da65-4432-b6a8-854085c66d11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:35.561492 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1f738d3-da65-4432-b6a8-854085c66d11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:35.561907 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1f738d3-da65-4432-b6a8-854085c66d11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:35.718991 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b1f738d3-da65-4432-b6a8-854085c66d11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:35.729610 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b1f738d3-da65-4432-b6a8-854085c66d11 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.181578 Aug 05 07:15:35.730633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 134/253] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:35 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:36.135385 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:36.136089 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:36.143538 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:36.143994 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:36.144847 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:36.146516 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:36.147742 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:36.148550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:36.192450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:36.193170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:36.193748 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:36.194351 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lazy-loading 'fault' on Instance uuid 076d8f98-2ac9-4f41-ad6b-41eaa1428706 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:15:36.245299 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cedcecb65ea45aa8b37797907d69009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8827c8710749d387f23d4ce8b35fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:36.254112 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-037ef33c-6295-41d3-8ab5-87347960d697 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 200 len: 1351 microversion: 2.1 time: 0.124062 Aug 05 07:15:36.255825 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 120/254] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:36 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 1351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:36.752915 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e7cbc053-851c-4ebb-bfb6-3978a619f290 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:36.753544 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e7cbc053-851c-4ebb-bfb6-3978a619f290 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:36.759947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7cbc053-851c-4ebb-bfb6-3978a619f290 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:36.760436 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7cbc053-851c-4ebb-bfb6-3978a619f290 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:36.764886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7cbc053-851c-4ebb-bfb6-3978a619f290 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:36.764886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7cbc053-851c-4ebb-bfb6-3978a619f290 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:36.764886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7cbc053-851c-4ebb-bfb6-3978a619f290 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:36.764886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7cbc053-851c-4ebb-bfb6-3978a619f290 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:36.904734 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e7cbc053-851c-4ebb-bfb6-3978a619f290 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:36.914109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e7cbc053-851c-4ebb-bfb6-3978a619f290 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.165093 Aug 05 07:15:36.914699 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 135/255] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:36 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:37.275047 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e3e5aa00-f5d5-481c-aefe-522d94db2f02 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:37.275820 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e3e5aa00-f5d5-481c-aefe-522d94db2f02 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:37.286936 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:37.291980 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3e5aa00-f5d5-481c-aefe-522d94db2f02 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:37.292496 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3e5aa00-f5d5-481c-aefe-522d94db2f02 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:37.293141 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3e5aa00-f5d5-481c-aefe-522d94db2f02 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:37.293920 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3e5aa00-f5d5-481c-aefe-522d94db2f02 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:37.294373 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3e5aa00-f5d5-481c-aefe-522d94db2f02 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:37.294967 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3e5aa00-f5d5-481c-aefe-522d94db2f02 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:37.312883 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-e3e5aa00-f5d5-481c-aefe-522d94db2f02 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] HTTP exception thrown: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e3e5aa00-f5d5-481c-aefe-522d94db2f02 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Request method failure captured: Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 HTTP/1.1 Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MNBeENx2vBemDbMbxqZNheeGuc_NYwuSekCck_OiHsk4KAoqualidHdZv0IOKYe0IP0Sr1KzOsflvtwaMJpQ7Jbm89moPEQu10mdhfPoJhB9SJYca-rZ3EKIvOQ6dgZmqtnfo2UBopQ_-L7tg9GB8EGrhyta26pW2OTc1CB9yW7Y3w Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: ab8827c8710749d387f23d4ce8b35fd4 Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-DeleteServersTestJSON-1784442318 Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:15:37.320376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:15:37.322125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ab8827c8710749d387f23d4ce8b35fd4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ab8827c8710749d387f23d4ce8b35fd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ab8827c8710749d387f23d4ce8b35fd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ab8827c8710749d387f23d4ce8b35fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:15:37.322125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-DeleteServersTestJSON-1784442318 Aug 05 07:15:37.322125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: ab8827c8710749d387f23d4ce8b35fd4 Aug 05 07:15:37.322125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-DeleteServersTestJSON-1784442318 Aug 05 07:15:37.322125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-DeleteServersTestJSON-1784442318-project Aug 05 07:15:37.322125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:15:37.322125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:15:37.322125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 9cedcecb65ea45aa8b37797907d69009 Aug 05 07:15:37.322125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-DeleteServersTestJSON-1784442318-project Aug 05 07:15:37.322125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:15:37.322125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:37.322125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '076d8f98-2ac9-4f41-ad6b-41eaa1428706'} Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:15:37.322993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:37.324677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:15:37.330851 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e3e5aa00-f5d5-481c-aefe-522d94db2f02 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Returning 404 to user: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:15:37.331577 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e3e5aa00-f5d5-481c-aefe-522d94db2f02 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 404 len: 111 microversion: 2.1 time: 0.060706 Aug 05 07:15:37.332484 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 121/256] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:37 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:15:37.452282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-115bd48c-c013-4543-b112-0c11652f0b6c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:37.454795 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-115bd48c-c013-4543-b112-0c11652f0b6c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:37.461659 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-115bd48c-c013-4543-b112-0c11652f0b6c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:37.462139 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-115bd48c-c013-4543-b112-0c11652f0b6c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:37.462572 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-115bd48c-c013-4543-b112-0c11652f0b6c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:37.463271 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-115bd48c-c013-4543-b112-0c11652f0b6c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:37.463708 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-115bd48c-c013-4543-b112-0c11652f0b6c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:37.464124 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-115bd48c-c013-4543-b112-0c11652f0b6c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:37.479097 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-115bd48c-c013-4543-b112-0c11652f0b6c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] HTTP exception thrown: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-115bd48c-c013-4543-b112-0c11652f0b6c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Request method failure captured: Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706/os-volume_attachments HTTP/1.1 Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MNBeENx2vBemDbMbxqZNheeGuc_NYwuSekCck_OiHsk4KAoqualidHdZv0IOKYe0IP0Sr1KzOsflvtwaMJpQ7Jbm89moPEQu10mdhfPoJhB9SJYca-rZ3EKIvOQ6dgZmqtnfo2UBopQ_-L7tg9GB8EGrhyta26pW2OTc1CB9yW7Y3w Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: ab8827c8710749d387f23d4ce8b35fd4 Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-DeleteServersTestJSON-1784442318 Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:15:37.484016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:15:37.485426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ab8827c8710749d387f23d4ce8b35fd4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ab8827c8710749d387f23d4ce8b35fd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ab8827c8710749d387f23d4ce8b35fd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ab8827c8710749d387f23d4ce8b35fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:15:37.485426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-DeleteServersTestJSON-1784442318 Aug 05 07:15:37.485426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: ab8827c8710749d387f23d4ce8b35fd4 Aug 05 07:15:37.485426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-DeleteServersTestJSON-1784442318 Aug 05 07:15:37.485426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-DeleteServersTestJSON-1784442318-project Aug 05 07:15:37.485426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:15:37.485426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:15:37.485426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 9cedcecb65ea45aa8b37797907d69009 Aug 05 07:15:37.485426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-DeleteServersTestJSON-1784442318-project Aug 05 07:15:37.485426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:15:37.485426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:37.485426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'server_id': '076d8f98-2ac9-4f41-ad6b-41eaa1428706'} Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:15:37.486077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:37.487108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:15:37.490065 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-115bd48c-c013-4543-b112-0c11652f0b6c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Returning 404 to user: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:15:37.491009 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-115bd48c-c013-4543-b112-0c11652f0b6c tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043397 Aug 05 07:15:37.491566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 136/257] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:15:37 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:15:37.936802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a77aa0ec-919d-408e-8b99-07f3cd051e31 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:37.941392 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a77aa0ec-919d-408e-8b99-07f3cd051e31 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:37.957148 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a77aa0ec-919d-408e-8b99-07f3cd051e31 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:37.958726 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a77aa0ec-919d-408e-8b99-07f3cd051e31 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:37.959170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a77aa0ec-919d-408e-8b99-07f3cd051e31 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:37.959864 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a77aa0ec-919d-408e-8b99-07f3cd051e31 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:37.960312 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a77aa0ec-919d-408e-8b99-07f3cd051e31 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:37.960729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a77aa0ec-919d-408e-8b99-07f3cd051e31 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:38.181708 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a77aa0ec-919d-408e-8b99-07f3cd051e31 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:38.190082 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a77aa0ec-919d-408e-8b99-07f3cd051e31 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.258252 Aug 05 07:15:38.190644 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 122/258] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:37 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:38.708204 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5071b1c5-2522-494a-b133-23cc5e31b467 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:38.708960 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5071b1c5-2522-494a-b133-23cc5e31b467 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:38.715512 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5071b1c5-2522-494a-b133-23cc5e31b467 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:38.716146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5071b1c5-2522-494a-b133-23cc5e31b467 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:38.716576 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5071b1c5-2522-494a-b133-23cc5e31b467 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:38.717295 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5071b1c5-2522-494a-b133-23cc5e31b467 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:38.717733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5071b1c5-2522-494a-b133-23cc5e31b467 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:38.718138 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5071b1c5-2522-494a-b133-23cc5e31b467 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:38.735511 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-5071b1c5-2522-494a-b133-23cc5e31b467 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] HTTP exception thrown: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5071b1c5-2522-494a-b133-23cc5e31b467 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Request method failure captured: Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: DELETE /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 HTTP/1.1 Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MNBeENx2vBemDbMbxqZNheeGuc_NYwuSekCck_OiHsk4KAoqualidHdZv0IOKYe0IP0Sr1KzOsflvtwaMJpQ7Jbm89moPEQu10mdhfPoJhB9SJYca-rZ3EKIvOQ6dgZmqtnfo2UBopQ_-L7tg9GB8EGrhyta26pW2OTc1CB9yW7Y3w Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: ab8827c8710749d387f23d4ce8b35fd4 Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-DeleteServersTestJSON-1784442318 Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:15:38.738230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:15:38.739624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ab8827c8710749d387f23d4ce8b35fd4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ab8827c8710749d387f23d4ce8b35fd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ab8827c8710749d387f23d4ce8b35fd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ab8827c8710749d387f23d4ce8b35fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:15:38.739624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-DeleteServersTestJSON-1784442318 Aug 05 07:15:38.739624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: ab8827c8710749d387f23d4ce8b35fd4 Aug 05 07:15:38.739624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-DeleteServersTestJSON-1784442318 Aug 05 07:15:38.739624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-DeleteServersTestJSON-1784442318-project Aug 05 07:15:38.739624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:15:38.739624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:15:38.739624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 9cedcecb65ea45aa8b37797907d69009 Aug 05 07:15:38.739624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-DeleteServersTestJSON-1784442318-project Aug 05 07:15:38.739624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:15:38.739624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:38.739624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': '076d8f98-2ac9-4f41-ad6b-41eaa1428706'} Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:15:38.740409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:38.741749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:15:38.743737 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5071b1c5-2522-494a-b133-23cc5e31b467 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Returning 404 to user: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:15:38.744607 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5071b1c5-2522-494a-b133-23cc5e31b467 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 404 len: 111 microversion: 2.1 time: 0.045339 Aug 05 07:15:38.745211 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 137/259] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:15:38 2022] DELETE /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:15:38.753531 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1440424b-fcbf-4527-baf6-718f2fcdc5f6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:38.754125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1440424b-fcbf-4527-baf6-718f2fcdc5f6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] [instance: 076d8f98-2ac9-4f41-ad6b-41eaa1428706] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:38.760777 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1440424b-fcbf-4527-baf6-718f2fcdc5f6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:38.761332 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1440424b-fcbf-4527-baf6-718f2fcdc5f6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:38.761759 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1440424b-fcbf-4527-baf6-718f2fcdc5f6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:38.762511 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1440424b-fcbf-4527-baf6-718f2fcdc5f6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:38.762951 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1440424b-fcbf-4527-baf6-718f2fcdc5f6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:38.763493 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1440424b-fcbf-4527-baf6-718f2fcdc5f6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:38.777625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-1440424b-fcbf-4527-baf6-718f2fcdc5f6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] HTTP exception thrown: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1440424b-fcbf-4527-baf6-718f2fcdc5f6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Request method failure captured: Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 HTTP/1.1 Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MNBeENx2vBemDbMbxqZNheeGuc_NYwuSekCck_OiHsk4KAoqualidHdZv0IOKYe0IP0Sr1KzOsflvtwaMJpQ7Jbm89moPEQu10mdhfPoJhB9SJYca-rZ3EKIvOQ6dgZmqtnfo2UBopQ_-L7tg9GB8EGrhyta26pW2OTc1CB9yW7Y3w Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: ab8827c8710749d387f23d4ce8b35fd4 Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-DeleteServersTestJSON-1784442318 Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:15:38.779401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:15:38.780664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ab8827c8710749d387f23d4ce8b35fd4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ab8827c8710749d387f23d4ce8b35fd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ab8827c8710749d387f23d4ce8b35fd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ab8827c8710749d387f23d4ce8b35fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:15:38.780664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-DeleteServersTestJSON-1784442318 Aug 05 07:15:38.780664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: ab8827c8710749d387f23d4ce8b35fd4 Aug 05 07:15:38.780664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-DeleteServersTestJSON-1784442318 Aug 05 07:15:38.780664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-DeleteServersTestJSON-1784442318-project Aug 05 07:15:38.780664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:15:38.780664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:15:38.780664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 9cedcecb65ea45aa8b37797907d69009 Aug 05 07:15:38.780664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-DeleteServersTestJSON-1784442318-project Aug 05 07:15:38.780664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:15:38.780664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:38.780664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '076d8f98-2ac9-4f41-ad6b-41eaa1428706'} Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:15:38.781426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. Aug 05 07:15:38.782471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:15:38.783407 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1440424b-fcbf-4527-baf6-718f2fcdc5f6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] Returning 404 to user: Instance 076d8f98-2ac9-4f41-ad6b-41eaa1428706 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:15:38.783407 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1440424b-fcbf-4527-baf6-718f2fcdc5f6 tempest-DeleteServersTestJSON-1784442318 tempest-DeleteServersTestJSON-1784442318-project] 10.222.0.27 "GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706" status: 404 len: 111 microversion: 2.1 time: 0.031307 Aug 05 07:15:38.783407 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 123/260] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:38 2022] GET /compute/v2.1/servers/076d8f98-2ac9-4f41-ad6b-41eaa1428706 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:15:39.212683 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e2843a08-1e2e-4fdb-9191-8522af1982df tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:39.213643 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e2843a08-1e2e-4fdb-9191-8522af1982df tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:39.222417 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e2843a08-1e2e-4fdb-9191-8522af1982df tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:39.223242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e2843a08-1e2e-4fdb-9191-8522af1982df tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:39.224026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e2843a08-1e2e-4fdb-9191-8522af1982df tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:39.224740 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e2843a08-1e2e-4fdb-9191-8522af1982df tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:39.226948 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e2843a08-1e2e-4fdb-9191-8522af1982df tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:39.229987 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e2843a08-1e2e-4fdb-9191-8522af1982df tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:39.408836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e2843a08-1e2e-4fdb-9191-8522af1982df tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:39.419920 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:39.427025 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e2843a08-1e2e-4fdb-9191-8522af1982df tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1522 microversion: 2.1 time: 0.219934 Aug 05 07:15:39.427607 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 138/261] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:39 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:40.447763 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dcf0e5ad-3d79-45aa-a86e-a83f82524b38 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:40.448474 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dcf0e5ad-3d79-45aa-a86e-a83f82524b38 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:40.455860 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dcf0e5ad-3d79-45aa-a86e-a83f82524b38 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:40.456317 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dcf0e5ad-3d79-45aa-a86e-a83f82524b38 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:40.456964 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dcf0e5ad-3d79-45aa-a86e-a83f82524b38 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:40.457648 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dcf0e5ad-3d79-45aa-a86e-a83f82524b38 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:40.458232 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dcf0e5ad-3d79-45aa-a86e-a83f82524b38 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:40.458840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dcf0e5ad-3d79-45aa-a86e-a83f82524b38 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:40.662515 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dcf0e5ad-3d79-45aa-a86e-a83f82524b38 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:40.672144 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-dcf0e5ad-3d79-45aa-a86e-a83f82524b38 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1502 microversion: 2.1 time: 0.228221 Aug 05 07:15:40.672709 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 124/262] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:40 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:40.692689 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3a76db6e-99f5-4a3b-8eb3-09d14ccb98f3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:40.693295 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3a76db6e-99f5-4a3b-8eb3-09d14ccb98f3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:40.699662 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3a76db6e-99f5-4a3b-8eb3-09d14ccb98f3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:40.700241 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3a76db6e-99f5-4a3b-8eb3-09d14ccb98f3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:40.700749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3a76db6e-99f5-4a3b-8eb3-09d14ccb98f3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:40.701548 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3a76db6e-99f5-4a3b-8eb3-09d14ccb98f3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:40.702068 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3a76db6e-99f5-4a3b-8eb3-09d14ccb98f3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:40.702562 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3a76db6e-99f5-4a3b-8eb3-09d14ccb98f3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:40.839553 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3a76db6e-99f5-4a3b-8eb3-09d14ccb98f3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:40.847267 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3a76db6e-99f5-4a3b-8eb3-09d14ccb98f3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1517 microversion: 2.1 time: 0.158870 Aug 05 07:15:40.847832 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 139/263] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:40 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:46.532317 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-96560e36-d22b-4bd1-bd1a-fcd38f3d7390 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:46.535600 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-96560e36-d22b-4bd1-bd1a-fcd38f3d7390 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:46.542368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96560e36-d22b-4bd1-bd1a-fcd38f3d7390 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:46.542870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96560e36-d22b-4bd1-bd1a-fcd38f3d7390 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:46.543372 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96560e36-d22b-4bd1-bd1a-fcd38f3d7390 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:46.544253 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96560e36-d22b-4bd1-bd1a-fcd38f3d7390 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:46.545184 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96560e36-d22b-4bd1-bd1a-fcd38f3d7390 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:46.545767 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96560e36-d22b-4bd1-bd1a-fcd38f3d7390 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:46.570822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-96560e36-d22b-4bd1-bd1a-fcd38f3d7390 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lazy-loading 'flavor' on Instance uuid f899e07a-87f6-4228-9dc1-c92ec3eed017 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:15:46.734807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:46.756214 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-96560e36-d22b-4bd1-bd1a-fcd38f3d7390 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "POST /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017/action" status: 200 len: 32 microversion: 2.1 time: 0.229841 Aug 05 07:15:46.757345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 125/264] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:15:46 2022] POST /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 07:15:46.772683 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4e091b20-11cb-47e9-b376-3114ad74a458 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:46.773384 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4e091b20-11cb-47e9-b376-3114ad74a458 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:46.791102 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e091b20-11cb-47e9-b376-3114ad74a458 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:46.791585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e091b20-11cb-47e9-b376-3114ad74a458 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:46.798222 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e091b20-11cb-47e9-b376-3114ad74a458 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:46.800166 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e091b20-11cb-47e9-b376-3114ad74a458 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:46.801614 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e091b20-11cb-47e9-b376-3114ad74a458 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:46.802052 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e091b20-11cb-47e9-b376-3114ad74a458 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:47.062982 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4e091b20-11cb-47e9-b376-3114ad74a458 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:47.082793 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4e091b20-11cb-47e9-b376-3114ad74a458 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.319750 Aug 05 07:15:47.098232 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 140/265] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:46 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:48.106382 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-62237e52-037b-46d0-a0a2-171efed93176 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:48.107184 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-62237e52-037b-46d0-a0a2-171efed93176 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:48.117341 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62237e52-037b-46d0-a0a2-171efed93176 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:48.117835 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62237e52-037b-46d0-a0a2-171efed93176 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:48.119721 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62237e52-037b-46d0-a0a2-171efed93176 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:48.120752 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62237e52-037b-46d0-a0a2-171efed93176 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:48.121639 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62237e52-037b-46d0-a0a2-171efed93176 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:48.122390 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62237e52-037b-46d0-a0a2-171efed93176 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:48.360403 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-62237e52-037b-46d0-a0a2-171efed93176 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:48.393014 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-62237e52-037b-46d0-a0a2-171efed93176 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.289558 Aug 05 07:15:48.393868 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 126/266] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:48 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:48.941341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-41e795e6-0d06-489c-89a0-68ebfa78540c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Action: 'create', calling method: .version_select at 0x7f4971cdcb80>, body: {"keypair": {"name": "tempest-keypair-75278466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5+AdnyIutyHxSqu+DBd93x+1a0R0uRURyhsks6I3UphXTGJ3VScKzec7CnJdNfpWVz6mZ9Xc5+IHXIJkAClVo+w7M8te1kv5ccxvJFQgaldTwu/gpb5hxsZOcRENTb+A=="}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:48.948785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=50 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:48.960513 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-41e795e6-0d06-489c-89a0-68ebfa78540c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Getting quotas for project f3385eb4afc441ba834ec0ddc1c3fd9a. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:15:48.977628 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-41e795e6-0d06-489c-89a0-68ebfa78540c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Getting quotas for user 723cdd3baceb4f51a57df4863af99c3e and project f3385eb4afc441ba834ec0ddc1c3fd9a. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:15:49.002561 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-41e795e6-0d06-489c-89a0-68ebfa78540c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.195348 Aug 05 07:15:49.003168 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 141/267] 10.222.0.27 () {62 vars in 1200 bytes} [Fri Aug 5 07:15:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 197 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 05 07:15:49.415270 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5e9048be-e6f6-469b-aa7a-cfdbdb79b7d6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:49.416140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5e9048be-e6f6-469b-aa7a-cfdbdb79b7d6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:49.422489 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e9048be-e6f6-469b-aa7a-cfdbdb79b7d6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:49.422970 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e9048be-e6f6-469b-aa7a-cfdbdb79b7d6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:49.423391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e9048be-e6f6-469b-aa7a-cfdbdb79b7d6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:49.424101 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e9048be-e6f6-469b-aa7a-cfdbdb79b7d6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:49.424542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e9048be-e6f6-469b-aa7a-cfdbdb79b7d6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:49.424975 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e9048be-e6f6-469b-aa7a-cfdbdb79b7d6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:49.568850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5e9048be-e6f6-469b-aa7a-cfdbdb79b7d6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:49.577329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5e9048be-e6f6-469b-aa7a-cfdbdb79b7d6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.165996 Aug 05 07:15:49.577917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 127/268] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:49 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:50.459899 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1601947815", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5cb1f597-6366-4fa9-b689-ca18264fbf89"}], "security_groups": [{"name": "tempest-securitygroup--1347327677"}], "key_name": "tempest-keypair-75278466", "user_data": "}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:50.598556 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a9e4d894-6af9-43b5-84ea-cd7f4be607b2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:50.599231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a9e4d894-6af9-43b5-84ea-cd7f4be607b2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:50.605554 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] validate_networks() for [('5cb1f597-6366-4fa9-b689-ca18264fbf89', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:15:50.613027 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e4d894-6af9-43b5-84ea-cd7f4be607b2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:50.613513 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e4d894-6af9-43b5-84ea-cd7f4be607b2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:50.613945 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e4d894-6af9-43b5-84ea-cd7f4be607b2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:50.614648 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e4d894-6af9-43b5-84ea-cd7f4be607b2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:50.615105 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e4d894-6af9-43b5-84ea-cd7f4be607b2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:50.615524 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e4d894-6af9-43b5-84ea-cd7f4be607b2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:50.779080 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a9e4d894-6af9-43b5-84ea-cd7f4be607b2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:50.788167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a9e4d894-6af9-43b5-84ea-cd7f4be607b2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.193433 Aug 05 07:15:50.789461 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 128/269] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:50 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:15:51.043448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:15:51.044284 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:15:51.044380 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:15:51.044882 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:15:51.045508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:15:51.056147 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:51.056635 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:51.057110 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:51.058011 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:51.058524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:51.058940 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:51.081459 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Getting quotas for project f3385eb4afc441ba834ec0ddc1c3fd9a. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:15:51.085492 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Getting quotas for user 723cdd3baceb4f51a57df4863af99c3e and project f3385eb4afc441ba834ec0ddc1c3fd9a. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:15:51.096837 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:15:51.099829 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:15:51.149922 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4a43b737-8f53-49fa-a014-4269e956b378 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.696419 Aug 05 07:15:51.150742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 142/270] 10.222.0.27 () {62 vars in 1188 bytes} [Fri Aug 5 07:15:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 07:15:51.163672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3db92d4e-d95d-4381-a555-60b65c3655a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:51.164373 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3db92d4e-d95d-4381-a555-60b65c3655a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:51.224321 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3db92d4e-d95d-4381-a555-60b65c3655a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:51.231709 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3db92d4e-d95d-4381-a555-60b65c3655a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:51.233310 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3db92d4e-d95d-4381-a555-60b65c3655a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:51.234480 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3db92d4e-d95d-4381-a555-60b65c3655a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1280 microversion: 2.20 time: 0.076457 Aug 05 07:15:51.235022 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 129/271] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:15:51 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:15:51.812171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d02d5d33-4eeb-48d5-86fa-442e3b77fe1e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:51.814516 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d02d5d33-4eeb-48d5-86fa-442e3b77fe1e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:51.827056 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d02d5d33-4eeb-48d5-86fa-442e3b77fe1e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:51.827677 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d02d5d33-4eeb-48d5-86fa-442e3b77fe1e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:51.828166 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d02d5d33-4eeb-48d5-86fa-442e3b77fe1e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:51.829005 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d02d5d33-4eeb-48d5-86fa-442e3b77fe1e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:51.829699 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d02d5d33-4eeb-48d5-86fa-442e3b77fe1e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:51.830418 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d02d5d33-4eeb-48d5-86fa-442e3b77fe1e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:52.039550 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d02d5d33-4eeb-48d5-86fa-442e3b77fe1e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:52.050554 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d02d5d33-4eeb-48d5-86fa-442e3b77fe1e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.244825 Aug 05 07:15:52.054180 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 143/272] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:51 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:52.261258 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f2a24c8f-badf-4ad6-95f3-ea76f763a9d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:52.263867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f2a24c8f-badf-4ad6-95f3-ea76f763a9d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:52.428798 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f2a24c8f-badf-4ad6-95f3-ea76f763a9d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:52.429383 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f2a24c8f-badf-4ad6-95f3-ea76f763a9d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:52.429673 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f2a24c8f-badf-4ad6-95f3-ea76f763a9d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:52.430403 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f2a24c8f-badf-4ad6-95f3-ea76f763a9d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:52.430871 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f2a24c8f-badf-4ad6-95f3-ea76f763a9d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:52.431261 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f2a24c8f-badf-4ad6-95f3-ea76f763a9d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:52.499112 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f2a24c8f-badf-4ad6-95f3-ea76f763a9d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:52.508832 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f2a24c8f-badf-4ad6-95f3-ea76f763a9d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:52.510908 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f2a24c8f-badf-4ad6-95f3-ea76f763a9d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:52.512518 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f2a24c8f-badf-4ad6-95f3-ea76f763a9d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1332 microversion: 2.20 time: 0.258046 Aug 05 07:15:52.513249 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 130/273] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:15:52 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1332 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:15:53.075653 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-de06dad3-c147-48a5-8ee7-e450e4c0c658 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:53.077612 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-de06dad3-c147-48a5-8ee7-e450e4c0c658 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:53.098551 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de06dad3-c147-48a5-8ee7-e450e4c0c658 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:53.099042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de06dad3-c147-48a5-8ee7-e450e4c0c658 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:53.099638 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de06dad3-c147-48a5-8ee7-e450e4c0c658 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:53.100503 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de06dad3-c147-48a5-8ee7-e450e4c0c658 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:53.101145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de06dad3-c147-48a5-8ee7-e450e4c0c658 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:53.101626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de06dad3-c147-48a5-8ee7-e450e4c0c658 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:53.537019 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d4ace9d6-ccfa-40ef-9195-1a214fc6407d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:53.537597 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d4ace9d6-ccfa-40ef-9195-1a214fc6407d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:53.544757 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d4ace9d6-ccfa-40ef-9195-1a214fc6407d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:53.545286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d4ace9d6-ccfa-40ef-9195-1a214fc6407d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:53.545689 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d4ace9d6-ccfa-40ef-9195-1a214fc6407d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:53.546814 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d4ace9d6-ccfa-40ef-9195-1a214fc6407d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:53.547460 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d4ace9d6-ccfa-40ef-9195-1a214fc6407d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:53.547856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d4ace9d6-ccfa-40ef-9195-1a214fc6407d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:53.573264 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-de06dad3-c147-48a5-8ee7-e450e4c0c658 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:53.583320 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-de06dad3-c147-48a5-8ee7-e450e4c0c658 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.512613 Aug 05 07:15:53.584022 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 144/274] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:53 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:53.709284 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d4ace9d6-ccfa-40ef-9195-1a214fc6407d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:53.722696 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d4ace9d6-ccfa-40ef-9195-1a214fc6407d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:53.728621 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d4ace9d6-ccfa-40ef-9195-1a214fc6407d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:53.729826 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d4ace9d6-ccfa-40ef-9195-1a214fc6407d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.197277 Aug 05 07:15:53.730526 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 131/275] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:15:53 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:15:54.329603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-875755d8-ad97-45a4-a0e1-ab1e0709e247 req-21d3d42e-e4bc-44b8-8144-701b5bfaaa11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f664511a-28db-4ff6-90e9-7e2db58e94e2", "tag": "986a1785-c18c-444a-af3e-101b2ea68ae7"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:15:54.343250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-875755d8-ad97-45a4-a0e1-ab1e0709e247 req-21d3d42e-e4bc-44b8-8144-701b5bfaaa11 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:54.343962 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-875755d8-ad97-45a4-a0e1-ab1e0709e247 req-21d3d42e-e4bc-44b8-8144-701b5bfaaa11 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:54.344597 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-875755d8-ad97-45a4-a0e1-ab1e0709e247 req-21d3d42e-e4bc-44b8-8144-701b5bfaaa11 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:54.378696 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-875755d8-ad97-45a4-a0e1-ab1e0709e247 req-21d3d42e-e4bc-44b8-8144-701b5bfaaa11 service nova] Creating event network-changed:986a1785-c18c-444a-af3e-101b2ea68ae7 for instance f664511a-28db-4ff6-90e9-7e2db58e94e2 on hv-cinder-85200 Aug 05 07:15:54.383775 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-875755d8-ad97-45a4-a0e1-ab1e0709e247 req-21d3d42e-e4bc-44b8-8144-701b5bfaaa11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058359 Aug 05 07:15:54.384390 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 145/276] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:15:54.606210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3ada8760-b292-4c72-8310-71c41b89131c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:54.606800 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3ada8760-b292-4c72-8310-71c41b89131c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:54.614743 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ada8760-b292-4c72-8310-71c41b89131c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:54.615228 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ada8760-b292-4c72-8310-71c41b89131c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:54.615656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ada8760-b292-4c72-8310-71c41b89131c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:54.616365 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ada8760-b292-4c72-8310-71c41b89131c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:54.616840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ada8760-b292-4c72-8310-71c41b89131c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:54.617306 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ada8760-b292-4c72-8310-71c41b89131c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:54.753455 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4933153c-5ade-48b2-b0ea-112f0bf9b128 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:54.754168 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4933153c-5ade-48b2-b0ea-112f0bf9b128 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:54.760620 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4933153c-5ade-48b2-b0ea-112f0bf9b128 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:54.761145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4933153c-5ade-48b2-b0ea-112f0bf9b128 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:54.761627 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4933153c-5ade-48b2-b0ea-112f0bf9b128 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:54.762215 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3ada8760-b292-4c72-8310-71c41b89131c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:54.762342 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4933153c-5ade-48b2-b0ea-112f0bf9b128 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:54.762804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4933153c-5ade-48b2-b0ea-112f0bf9b128 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:54.763229 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4933153c-5ade-48b2-b0ea-112f0bf9b128 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:54.770409 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3ada8760-b292-4c72-8310-71c41b89131c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.168430 Aug 05 07:15:54.771333 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 132/277] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:54 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:54.941383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4933153c-5ade-48b2-b0ea-112f0bf9b128 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:54.952114 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4933153c-5ade-48b2-b0ea-112f0bf9b128 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:54.953675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4933153c-5ade-48b2-b0ea-112f0bf9b128 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:54.954838 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4933153c-5ade-48b2-b0ea-112f0bf9b128 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.206384 Aug 05 07:15:54.955397 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 146/278] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:15:54 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:15:55.793106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e96a801a-d84c-4b8b-9212-32fc3dcf46ba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:55.793907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e96a801a-d84c-4b8b-9212-32fc3dcf46ba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:55.801303 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e96a801a-d84c-4b8b-9212-32fc3dcf46ba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:55.801791 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e96a801a-d84c-4b8b-9212-32fc3dcf46ba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:55.802239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e96a801a-d84c-4b8b-9212-32fc3dcf46ba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:55.802938 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e96a801a-d84c-4b8b-9212-32fc3dcf46ba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:55.803394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e96a801a-d84c-4b8b-9212-32fc3dcf46ba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:55.803819 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e96a801a-d84c-4b8b-9212-32fc3dcf46ba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:55.955077 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e96a801a-d84c-4b8b-9212-32fc3dcf46ba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:55.962885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e96a801a-d84c-4b8b-9212-32fc3dcf46ba tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.175210 Aug 05 07:15:55.963482 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 133/279] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:55 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:55.977405 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5b1b8fce-8adc-4b75-8b83-b59668125c42 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:55.978221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5b1b8fce-8adc-4b75-8b83-b59668125c42 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:55.985000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5b1b8fce-8adc-4b75-8b83-b59668125c42 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:55.985520 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5b1b8fce-8adc-4b75-8b83-b59668125c42 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:55.986100 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5b1b8fce-8adc-4b75-8b83-b59668125c42 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:55.986865 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5b1b8fce-8adc-4b75-8b83-b59668125c42 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:55.987380 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5b1b8fce-8adc-4b75-8b83-b59668125c42 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:55.987855 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5b1b8fce-8adc-4b75-8b83-b59668125c42 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:56.138033 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5b1b8fce-8adc-4b75-8b83-b59668125c42 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:56.147519 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5b1b8fce-8adc-4b75-8b83-b59668125c42 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:56.149144 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5b1b8fce-8adc-4b75-8b83-b59668125c42 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:56.150340 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5b1b8fce-8adc-4b75-8b83-b59668125c42 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.177219 Aug 05 07:15:56.150904 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 147/280] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:15:55 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:15:56.985684 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f3244e80-0404-4b48-97e7-09bd8f1e151e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:56.987128 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f3244e80-0404-4b48-97e7-09bd8f1e151e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:56.994776 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3244e80-0404-4b48-97e7-09bd8f1e151e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:56.995250 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3244e80-0404-4b48-97e7-09bd8f1e151e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:56.995673 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3244e80-0404-4b48-97e7-09bd8f1e151e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:56.996405 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3244e80-0404-4b48-97e7-09bd8f1e151e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:56.997001 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3244e80-0404-4b48-97e7-09bd8f1e151e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:56.997517 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3244e80-0404-4b48-97e7-09bd8f1e151e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:57.134974 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f3244e80-0404-4b48-97e7-09bd8f1e151e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:57.148547 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f3244e80-0404-4b48-97e7-09bd8f1e151e tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.167443 Aug 05 07:15:57.149141 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 134/281] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:56 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:57.174879 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e320fdb5-c4fd-47e3-b35c-731294d491da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:57.176541 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e320fdb5-c4fd-47e3-b35c-731294d491da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:57.185140 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e320fdb5-c4fd-47e3-b35c-731294d491da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:57.185925 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e320fdb5-c4fd-47e3-b35c-731294d491da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:57.186716 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e320fdb5-c4fd-47e3-b35c-731294d491da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:57.187462 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e320fdb5-c4fd-47e3-b35c-731294d491da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:57.187936 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e320fdb5-c4fd-47e3-b35c-731294d491da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:57.188353 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e320fdb5-c4fd-47e3-b35c-731294d491da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:57.344460 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e320fdb5-c4fd-47e3-b35c-731294d491da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:57.353547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e320fdb5-c4fd-47e3-b35c-731294d491da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:57.355133 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e320fdb5-c4fd-47e3-b35c-731294d491da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:57.356261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e320fdb5-c4fd-47e3-b35c-731294d491da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.185373 Aug 05 07:15:57.356779 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 148/282] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:15:57 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:15:58.170404 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-206e2b96-9052-43ee-9843-1718771c5579 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:58.171007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-206e2b96-9052-43ee-9843-1718771c5579 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:58.189362 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-206e2b96-9052-43ee-9843-1718771c5579 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:58.189845 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-206e2b96-9052-43ee-9843-1718771c5579 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:58.190259 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-206e2b96-9052-43ee-9843-1718771c5579 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:58.191004 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-206e2b96-9052-43ee-9843-1718771c5579 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:58.191460 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-206e2b96-9052-43ee-9843-1718771c5579 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:58.191868 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-206e2b96-9052-43ee-9843-1718771c5579 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:58.337654 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-206e2b96-9052-43ee-9843-1718771c5579 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:58.345547 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-206e2b96-9052-43ee-9843-1718771c5579 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.179337 Aug 05 07:15:58.346122 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 135/283] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:58 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:58.379504 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-48697e46-9e47-4380-a557-6cff7ceb3828 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:58.380121 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-48697e46-9e47-4380-a557-6cff7ceb3828 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:58.387284 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48697e46-9e47-4380-a557-6cff7ceb3828 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:58.387774 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48697e46-9e47-4380-a557-6cff7ceb3828 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:58.388201 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48697e46-9e47-4380-a557-6cff7ceb3828 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:58.389031 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48697e46-9e47-4380-a557-6cff7ceb3828 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:58.389481 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48697e46-9e47-4380-a557-6cff7ceb3828 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:58.389897 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48697e46-9e47-4380-a557-6cff7ceb3828 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:58.525585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-48697e46-9e47-4380-a557-6cff7ceb3828 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:58.537070 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-48697e46-9e47-4380-a557-6cff7ceb3828 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:58.539533 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-48697e46-9e47-4380-a557-6cff7ceb3828 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:58.541260 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-48697e46-9e47-4380-a557-6cff7ceb3828 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.166395 Aug 05 07:15:58.542015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 149/284] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:15:58 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:15:59.369028 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-35b3bd1c-171d-46d9-86df-fe31ad6b7a85 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:59.370719 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-35b3bd1c-171d-46d9-86df-fe31ad6b7a85 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:59.378845 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35b3bd1c-171d-46d9-86df-fe31ad6b7a85 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:59.379334 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35b3bd1c-171d-46d9-86df-fe31ad6b7a85 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:59.379760 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35b3bd1c-171d-46d9-86df-fe31ad6b7a85 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:59.380467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35b3bd1c-171d-46d9-86df-fe31ad6b7a85 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:59.380957 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35b3bd1c-171d-46d9-86df-fe31ad6b7a85 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:59.381370 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35b3bd1c-171d-46d9-86df-fe31ad6b7a85 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:59.521216 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-35b3bd1c-171d-46d9-86df-fe31ad6b7a85 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:59.529467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-35b3bd1c-171d-46d9-86df-fe31ad6b7a85 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.166813 Aug 05 07:15:59.530078 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 136/285] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:15:59 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:15:59.565544 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b38708f6-584a-48f9-b725-7b08157f079f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:15:59.566354 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b38708f6-584a-48f9-b725-7b08157f079f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:15:59.573424 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b38708f6-584a-48f9-b725-7b08157f079f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:59.573933 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b38708f6-584a-48f9-b725-7b08157f079f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:59.574351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b38708f6-584a-48f9-b725-7b08157f079f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:59.575084 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b38708f6-584a-48f9-b725-7b08157f079f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:15:59.575805 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b38708f6-584a-48f9-b725-7b08157f079f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:15:59.576283 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b38708f6-584a-48f9-b725-7b08157f079f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:15:59.725958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b38708f6-584a-48f9-b725-7b08157f079f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:59.735160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b38708f6-584a-48f9-b725-7b08157f079f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:59.736666 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b38708f6-584a-48f9-b725-7b08157f079f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:15:59.737816 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b38708f6-584a-48f9-b725-7b08157f079f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.177268 Aug 05 07:15:59.738370 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 150/286] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:15:59 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:16:00.551810 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3e4e4226-d514-4d4e-b896-85d81a5aa8f9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:00.553494 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3e4e4226-d514-4d4e-b896-85d81a5aa8f9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:00.561813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e4e4226-d514-4d4e-b896-85d81a5aa8f9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:00.562408 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e4e4226-d514-4d4e-b896-85d81a5aa8f9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:00.562929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e4e4226-d514-4d4e-b896-85d81a5aa8f9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:00.564026 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e4e4226-d514-4d4e-b896-85d81a5aa8f9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:00.564766 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e4e4226-d514-4d4e-b896-85d81a5aa8f9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:00.565493 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e4e4226-d514-4d4e-b896-85d81a5aa8f9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:00.732685 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3e4e4226-d514-4d4e-b896-85d81a5aa8f9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:00.740977 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3e4e4226-d514-4d4e-b896-85d81a5aa8f9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.193881 Aug 05 07:16:00.741491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 137/287] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:00 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:00.761609 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c18586d4-edd4-40a1-8a16-ea5a4b468a83 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:00.762305 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c18586d4-edd4-40a1-8a16-ea5a4b468a83 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:00.768786 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c18586d4-edd4-40a1-8a16-ea5a4b468a83 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:00.769320 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c18586d4-edd4-40a1-8a16-ea5a4b468a83 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:00.769754 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c18586d4-edd4-40a1-8a16-ea5a4b468a83 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:00.770460 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c18586d4-edd4-40a1-8a16-ea5a4b468a83 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:00.770911 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c18586d4-edd4-40a1-8a16-ea5a4b468a83 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:00.771332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c18586d4-edd4-40a1-8a16-ea5a4b468a83 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:00.914963 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c18586d4-edd4-40a1-8a16-ea5a4b468a83 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:00.928082 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c18586d4-edd4-40a1-8a16-ea5a4b468a83 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:00.930427 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c18586d4-edd4-40a1-8a16-ea5a4b468a83 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:00.931845 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c18586d4-edd4-40a1-8a16-ea5a4b468a83 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.175755 Aug 05 07:16:00.932700 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 151/288] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:00 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:16:01.764341 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-63c26d0e-ec38-409c-9810-c4afb7bc9cb4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:01.764984 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-63c26d0e-ec38-409c-9810-c4afb7bc9cb4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:01.766970 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:01.773033 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63c26d0e-ec38-409c-9810-c4afb7bc9cb4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:01.773533 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63c26d0e-ec38-409c-9810-c4afb7bc9cb4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:01.773965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63c26d0e-ec38-409c-9810-c4afb7bc9cb4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:01.774667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63c26d0e-ec38-409c-9810-c4afb7bc9cb4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:01.775118 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63c26d0e-ec38-409c-9810-c4afb7bc9cb4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:01.775540 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63c26d0e-ec38-409c-9810-c4afb7bc9cb4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:01.914575 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-63c26d0e-ec38-409c-9810-c4afb7bc9cb4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:01.924573 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-63c26d0e-ec38-409c-9810-c4afb7bc9cb4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.164592 Aug 05 07:16:01.925198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 138/289] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:01 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:01.955324 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4da4d7db-2449-483e-a427-83e94fa286bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:01.955941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4da4d7db-2449-483e-a427-83e94fa286bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:01.957956 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:01.958615 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=10 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:01.965007 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4da4d7db-2449-483e-a427-83e94fa286bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:01.965496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4da4d7db-2449-483e-a427-83e94fa286bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:01.965933 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4da4d7db-2449-483e-a427-83e94fa286bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:01.966608 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4da4d7db-2449-483e-a427-83e94fa286bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:01.967058 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4da4d7db-2449-483e-a427-83e94fa286bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:01.967488 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4da4d7db-2449-483e-a427-83e94fa286bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:02.101245 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4da4d7db-2449-483e-a427-83e94fa286bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:02.109948 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4da4d7db-2449-483e-a427-83e94fa286bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:02.111444 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4da4d7db-2449-483e-a427-83e94fa286bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:02.112555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4da4d7db-2449-483e-a427-83e94fa286bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.161296 Aug 05 07:16:02.113157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 152/290] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:01 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:16:02.945861 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f034c484-d4e9-4441-afee-f77a6b319050 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:02.946401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f034c484-d4e9-4441-afee-f77a6b319050 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:02.953459 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f034c484-d4e9-4441-afee-f77a6b319050 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:02.953929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f034c484-d4e9-4441-afee-f77a6b319050 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:02.954351 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f034c484-d4e9-4441-afee-f77a6b319050 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:02.955087 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f034c484-d4e9-4441-afee-f77a6b319050 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:02.955747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f034c484-d4e9-4441-afee-f77a6b319050 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:02.956158 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f034c484-d4e9-4441-afee-f77a6b319050 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:03.112300 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f034c484-d4e9-4441-afee-f77a6b319050 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:03.120676 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f034c484-d4e9-4441-afee-f77a6b319050 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.178784 Aug 05 07:16:03.121472 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 139/291] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:02 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:03.142888 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-13ce8c4b-d5d9-40e3-87d7-f590f1bdeee3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:03.143460 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-13ce8c4b-d5d9-40e3-87d7-f590f1bdeee3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:03.150364 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13ce8c4b-d5d9-40e3-87d7-f590f1bdeee3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:03.151212 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13ce8c4b-d5d9-40e3-87d7-f590f1bdeee3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:03.151656 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13ce8c4b-d5d9-40e3-87d7-f590f1bdeee3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:03.152342 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13ce8c4b-d5d9-40e3-87d7-f590f1bdeee3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:03.152782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13ce8c4b-d5d9-40e3-87d7-f590f1bdeee3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:03.153232 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13ce8c4b-d5d9-40e3-87d7-f590f1bdeee3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:03.303663 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-13ce8c4b-d5d9-40e3-87d7-f590f1bdeee3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:03.313101 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-13ce8c4b-d5d9-40e3-87d7-f590f1bdeee3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:03.314624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-13ce8c4b-d5d9-40e3-87d7-f590f1bdeee3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:03.315769 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-13ce8c4b-d5d9-40e3-87d7-f590f1bdeee3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.176881 Aug 05 07:16:03.316337 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 153/292] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:03 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:16:04.142164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4e61cb42-8158-4053-be26-3f694f1b7f67 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:04.142816 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4e61cb42-8158-4053-be26-3f694f1b7f67 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:04.150264 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e61cb42-8158-4053-be26-3f694f1b7f67 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:04.150733 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e61cb42-8158-4053-be26-3f694f1b7f67 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:04.151497 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e61cb42-8158-4053-be26-3f694f1b7f67 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:04.152178 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e61cb42-8158-4053-be26-3f694f1b7f67 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:04.152621 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e61cb42-8158-4053-be26-3f694f1b7f67 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:04.153053 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e61cb42-8158-4053-be26-3f694f1b7f67 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:04.306135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4e61cb42-8158-4053-be26-3f694f1b7f67 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:04.314032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4e61cb42-8158-4053-be26-3f694f1b7f67 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.175787 Aug 05 07:16:04.314600 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 140/293] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:04 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:04.339390 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5cf2a414-4a1b-454b-8f18-b874aa9d93c4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:04.341094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5cf2a414-4a1b-454b-8f18-b874aa9d93c4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:04.347724 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5cf2a414-4a1b-454b-8f18-b874aa9d93c4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:04.348311 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5cf2a414-4a1b-454b-8f18-b874aa9d93c4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:04.348820 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5cf2a414-4a1b-454b-8f18-b874aa9d93c4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:04.349680 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5cf2a414-4a1b-454b-8f18-b874aa9d93c4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:04.350192 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5cf2a414-4a1b-454b-8f18-b874aa9d93c4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:04.350672 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5cf2a414-4a1b-454b-8f18-b874aa9d93c4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:04.497026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5cf2a414-4a1b-454b-8f18-b874aa9d93c4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:04.509332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5cf2a414-4a1b-454b-8f18-b874aa9d93c4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:04.511389 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5cf2a414-4a1b-454b-8f18-b874aa9d93c4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:04.513167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5cf2a414-4a1b-454b-8f18-b874aa9d93c4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.178771 Aug 05 07:16:04.514029 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 154/294] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:04 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:16:05.335197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c94a4fac-75d1-4c21-bfda-8e52239fe46c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:05.335806 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c94a4fac-75d1-4c21-bfda-8e52239fe46c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:05.347079 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c94a4fac-75d1-4c21-bfda-8e52239fe46c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:05.347588 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c94a4fac-75d1-4c21-bfda-8e52239fe46c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:05.348283 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c94a4fac-75d1-4c21-bfda-8e52239fe46c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:05.349388 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c94a4fac-75d1-4c21-bfda-8e52239fe46c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:05.349927 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c94a4fac-75d1-4c21-bfda-8e52239fe46c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:05.350627 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c94a4fac-75d1-4c21-bfda-8e52239fe46c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:05.499933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c94a4fac-75d1-4c21-bfda-8e52239fe46c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:05.511480 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c94a4fac-75d1-4c21-bfda-8e52239fe46c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.180150 Aug 05 07:16:05.512438 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 141/295] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:05 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:05.537857 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2b95be23-bc33-40a7-ae85-0bd42f8748d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:05.538419 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2b95be23-bc33-40a7-ae85-0bd42f8748d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:05.547951 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2b95be23-bc33-40a7-ae85-0bd42f8748d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:05.548583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2b95be23-bc33-40a7-ae85-0bd42f8748d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:05.549225 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2b95be23-bc33-40a7-ae85-0bd42f8748d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:05.550036 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2b95be23-bc33-40a7-ae85-0bd42f8748d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:05.550591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2b95be23-bc33-40a7-ae85-0bd42f8748d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:05.551150 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2b95be23-bc33-40a7-ae85-0bd42f8748d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:05.702552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2b95be23-bc33-40a7-ae85-0bd42f8748d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:05.710846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2b95be23-bc33-40a7-ae85-0bd42f8748d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:05.712301 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2b95be23-bc33-40a7-ae85-0bd42f8748d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:05.713426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2b95be23-bc33-40a7-ae85-0bd42f8748d8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.180894 Aug 05 07:16:05.713985 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 155/296] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:05 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:16:06.539052 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d2d9a1d9-acf7-44fe-965d-c9bf695f3df2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:06.540399 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d2d9a1d9-acf7-44fe-965d-c9bf695f3df2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:06.547968 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d2d9a1d9-acf7-44fe-965d-c9bf695f3df2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:06.548422 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d2d9a1d9-acf7-44fe-965d-c9bf695f3df2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:06.548884 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d2d9a1d9-acf7-44fe-965d-c9bf695f3df2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:06.549615 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d2d9a1d9-acf7-44fe-965d-c9bf695f3df2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:06.550058 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d2d9a1d9-acf7-44fe-965d-c9bf695f3df2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:06.550482 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d2d9a1d9-acf7-44fe-965d-c9bf695f3df2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:06.692063 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d2d9a1d9-acf7-44fe-965d-c9bf695f3df2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:06.700201 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d2d9a1d9-acf7-44fe-965d-c9bf695f3df2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.165939 Aug 05 07:16:06.700768 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 142/297] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:06 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:06.739384 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f33270e7-b5da-45be-984a-b9996656bd13 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:06.739947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f33270e7-b5da-45be-984a-b9996656bd13 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:06.748999 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f33270e7-b5da-45be-984a-b9996656bd13 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:06.749647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f33270e7-b5da-45be-984a-b9996656bd13 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:06.750192 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f33270e7-b5da-45be-984a-b9996656bd13 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:06.751203 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f33270e7-b5da-45be-984a-b9996656bd13 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:06.751879 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f33270e7-b5da-45be-984a-b9996656bd13 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:06.753112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f33270e7-b5da-45be-984a-b9996656bd13 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:06.895238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f33270e7-b5da-45be-984a-b9996656bd13 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:06.906669 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f33270e7-b5da-45be-984a-b9996656bd13 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:06.908179 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f33270e7-b5da-45be-984a-b9996656bd13 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:06.909333 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f33270e7-b5da-45be-984a-b9996656bd13 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.176310 Aug 05 07:16:06.909863 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 156/298] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:06 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:16:07.722607 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1c366135-5dd5-4a5b-b19f-f7f662863fef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:07.723243 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1c366135-5dd5-4a5b-b19f-f7f662863fef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:07.725140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=46 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:07.730665 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1c366135-5dd5-4a5b-b19f-f7f662863fef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:07.731143 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1c366135-5dd5-4a5b-b19f-f7f662863fef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:07.731635 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1c366135-5dd5-4a5b-b19f-f7f662863fef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:07.732281 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1c366135-5dd5-4a5b-b19f-f7f662863fef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:07.732708 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1c366135-5dd5-4a5b-b19f-f7f662863fef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:07.733154 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1c366135-5dd5-4a5b-b19f-f7f662863fef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:07.756576 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:07.877901 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1c366135-5dd5-4a5b-b19f-f7f662863fef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:07.888920 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1c366135-5dd5-4a5b-b19f-f7f662863fef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.170794 Aug 05 07:16:07.889729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 143/299] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:07 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:07.939308 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-bec9d393-27bf-4242-a7d1-37aec5ff14f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:07.940255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-bec9d393-27bf-4242-a7d1-37aec5ff14f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:07.947005 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bec9d393-27bf-4242-a7d1-37aec5ff14f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:07.947410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bec9d393-27bf-4242-a7d1-37aec5ff14f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:07.947837 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bec9d393-27bf-4242-a7d1-37aec5ff14f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:07.948527 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bec9d393-27bf-4242-a7d1-37aec5ff14f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:07.949007 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bec9d393-27bf-4242-a7d1-37aec5ff14f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:07.949426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bec9d393-27bf-4242-a7d1-37aec5ff14f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:08.091282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-bec9d393-27bf-4242-a7d1-37aec5ff14f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:08.096790 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:08.105893 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-bec9d393-27bf-4242-a7d1-37aec5ff14f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:08.107796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-bec9d393-27bf-4242-a7d1-37aec5ff14f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:08.108611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-bec9d393-27bf-4242-a7d1-37aec5ff14f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.173396 Aug 05 07:16:08.109207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 157/300] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:07 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:16:08.912745 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4d7422a3-4887-4610-8178-9ecb86c1be80 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:08.913535 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4d7422a3-4887-4610-8178-9ecb86c1be80 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:08.921111 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4d7422a3-4887-4610-8178-9ecb86c1be80 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:08.921586 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4d7422a3-4887-4610-8178-9ecb86c1be80 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:08.922008 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4d7422a3-4887-4610-8178-9ecb86c1be80 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:08.922796 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4d7422a3-4887-4610-8178-9ecb86c1be80 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:08.923285 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4d7422a3-4887-4610-8178-9ecb86c1be80 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:08.923677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4d7422a3-4887-4610-8178-9ecb86c1be80 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:09.069925 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4d7422a3-4887-4610-8178-9ecb86c1be80 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:09.077599 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4d7422a3-4887-4610-8178-9ecb86c1be80 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.169194 Aug 05 07:16:09.078184 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 144/301] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:08 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:09.131157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9325c1e5-e7b8-4800-a2cd-fdd16a366a5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:09.131751 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9325c1e5-e7b8-4800-a2cd-fdd16a366a5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:09.137952 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9325c1e5-e7b8-4800-a2cd-fdd16a366a5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:09.138420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9325c1e5-e7b8-4800-a2cd-fdd16a366a5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:09.138866 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9325c1e5-e7b8-4800-a2cd-fdd16a366a5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:09.139537 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9325c1e5-e7b8-4800-a2cd-fdd16a366a5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:09.139972 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9325c1e5-e7b8-4800-a2cd-fdd16a366a5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:09.140386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9325c1e5-e7b8-4800-a2cd-fdd16a366a5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:09.294663 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9325c1e5-e7b8-4800-a2cd-fdd16a366a5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:09.303138 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9325c1e5-e7b8-4800-a2cd-fdd16a366a5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:09.304650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9325c1e5-e7b8-4800-a2cd-fdd16a366a5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:09.305809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9325c1e5-e7b8-4800-a2cd-fdd16a366a5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.178840 Aug 05 07:16:09.306402 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 158/302] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:09 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:16:10.101094 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4a5e7eaa-7680-4f2f-847d-be38c5c080ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:10.102424 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4a5e7eaa-7680-4f2f-847d-be38c5c080ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:10.110558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a5e7eaa-7680-4f2f-847d-be38c5c080ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:10.111284 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a5e7eaa-7680-4f2f-847d-be38c5c080ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:10.111707 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a5e7eaa-7680-4f2f-847d-be38c5c080ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:10.112568 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a5e7eaa-7680-4f2f-847d-be38c5c080ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:10.113050 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a5e7eaa-7680-4f2f-847d-be38c5c080ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:10.113476 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a5e7eaa-7680-4f2f-847d-be38c5c080ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:10.261878 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4a5e7eaa-7680-4f2f-847d-be38c5c080ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:10.270803 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4a5e7eaa-7680-4f2f-847d-be38c5c080ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.176029 Aug 05 07:16:10.271372 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 145/303] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:10 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:10.330385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1f0851de-8f1f-4a5b-91fb-fa34804c1464 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:10.331493 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1f0851de-8f1f-4a5b-91fb-fa34804c1464 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:10.338387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f0851de-8f1f-4a5b-91fb-fa34804c1464 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:10.338867 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f0851de-8f1f-4a5b-91fb-fa34804c1464 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:10.339306 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f0851de-8f1f-4a5b-91fb-fa34804c1464 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:10.339984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f0851de-8f1f-4a5b-91fb-fa34804c1464 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:10.340476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f0851de-8f1f-4a5b-91fb-fa34804c1464 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:10.340834 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f0851de-8f1f-4a5b-91fb-fa34804c1464 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:10.562664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1f0851de-8f1f-4a5b-91fb-fa34804c1464 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:10.571457 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1f0851de-8f1f-4a5b-91fb-fa34804c1464 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:10.573000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1f0851de-8f1f-4a5b-91fb-fa34804c1464 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:10.574120 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1f0851de-8f1f-4a5b-91fb-fa34804c1464 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.250121 Aug 05 07:16:10.574683 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 159/304] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:10 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:16:11.102794 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-f6d0494e-33d8-4a59-b994-ff6c226aa603 req-bf2d6f96-853a-4ee6-9d5f-80fafd859688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f664511a-28db-4ff6-90e9-7e2db58e94e2", "name": "network-vif-plugged", "status": "completed", "tag": "986a1785-c18c-444a-af3e-101b2ea68ae7"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:16:11.113635 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-f6d0494e-33d8-4a59-b994-ff6c226aa603 req-bf2d6f96-853a-4ee6-9d5f-80fafd859688 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:11.114107 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-f6d0494e-33d8-4a59-b994-ff6c226aa603 req-bf2d6f96-853a-4ee6-9d5f-80fafd859688 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:11.114533 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-f6d0494e-33d8-4a59-b994-ff6c226aa603 req-bf2d6f96-853a-4ee6-9d5f-80fafd859688 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:11.125756 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-f6d0494e-33d8-4a59-b994-ff6c226aa603 req-bf2d6f96-853a-4ee6-9d5f-80fafd859688 service nova] Creating event network-vif-plugged:986a1785-c18c-444a-af3e-101b2ea68ae7 for instance f664511a-28db-4ff6-90e9-7e2db58e94e2 on hv-cinder-85200 Aug 05 07:16:11.131304 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-f6d0494e-33d8-4a59-b994-ff6c226aa603 req-bf2d6f96-853a-4ee6-9d5f-80fafd859688 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032766 Aug 05 07:16:11.132234 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 146/305] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:16:11.292385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a4d564cd-6844-490f-8857-ef95158a7d39 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:11.293598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a4d564cd-6844-490f-8857-ef95158a7d39 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:11.301185 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a4d564cd-6844-490f-8857-ef95158a7d39 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:11.301908 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a4d564cd-6844-490f-8857-ef95158a7d39 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:11.302932 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a4d564cd-6844-490f-8857-ef95158a7d39 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:11.303832 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a4d564cd-6844-490f-8857-ef95158a7d39 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:11.304462 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a4d564cd-6844-490f-8857-ef95158a7d39 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:11.305128 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a4d564cd-6844-490f-8857-ef95158a7d39 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:11.529085 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a4d564cd-6844-490f-8857-ef95158a7d39 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:11.537832 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a4d564cd-6844-490f-8857-ef95158a7d39 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1503 microversion: 2.1 time: 0.250056 Aug 05 07:16:11.538397 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 160/306] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:11 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:11.559941 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-526fd390-c2aa-4740-aea4-5cda005d2263 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39bdbf4b-7dcb-4446-af49-915066a63400"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:16:11.562841 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-526fd390-c2aa-4740-aea4-5cda005d2263 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:11.570532 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-526fd390-c2aa-4740-aea4-5cda005d2263 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:11.571038 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-526fd390-c2aa-4740-aea4-5cda005d2263 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:11.571499 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-526fd390-c2aa-4740-aea4-5cda005d2263 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:11.572245 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-526fd390-c2aa-4740-aea4-5cda005d2263 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:11.572809 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-526fd390-c2aa-4740-aea4-5cda005d2263 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:11.573151 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-526fd390-c2aa-4740-aea4-5cda005d2263 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:11.596736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-baae729f-8d61-4505-bf79-58f2c1544a86 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:11.597372 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-baae729f-8d61-4505-bf79-58f2c1544a86 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:11.599406 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-526fd390-c2aa-4740-aea4-5cda005d2263 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] HTTP exception thrown: Cannot 'attach_volume' instance f899e07a-87f6-4228-9dc1-c92ec3eed017 while it is in vm_state rescued Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-526fd390-c2aa-4740-aea4-5cda005d2263 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Request method failure captured: Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: POST /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017/os-volume_attachments HTTP/1.1 Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 74 Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MM-EQUpnzTV_TuaBii4EnDtucJf3DBJQuckc_cz-EahkMlyKuaPdeRlNPw5xVtsl6C2UBh_Yoa08ue84u1Lxb6YzWInBS__DjPsZZfDUKm9pQ3Ro_hNX8NmosRUVx0DbFBQGMhI8X49NbxrPMBizm2j_rmdwFPmQfNSyM6KMFZP8bo Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: fe39edf907ff48518759474a800b949d Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:16:11.601530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:16:11.602856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe39edf907ff48518759474a800b949d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe39edf907ff48518759474a800b949d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe39edf907ff48518759474a800b949d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe39edf907ff48518759474a800b949d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:16:11.602856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:16:11.602856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: fe39edf907ff48518759474a800b949d Aug 05 07:16:11.602856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:16:11.602856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-ServerRescueNegativeTestJSON-619170576-project Aug 05 07:16:11.602856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:16:11.602856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:16:11.602856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 2ce8bf4f0ab64010b3855193f55971d2 Aug 05 07:16:11.602856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-ServerRescueNegativeTestJSON-619170576-project Aug 05 07:16:11.602856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Aug 05 07:16:11.602856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {"volumeAttachment": {"volumeId": "39bdbf4b-7dcb-4446-af49-915066a63400"}} Aug 05 07:16:11.602856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Cannot 'attach_volume' instance f899e07a-87f6-4228-9dc1-c92ec3eed017 while it is in vm_state rescued Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'server_id': 'f899e07a-87f6-4228-9dc1-c92ec3eed017', 'body': {'volumeAttachment': {'volumeId': '39bdbf4b-7dcb-4446-af49-915066a63400'}}} Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f899e07a-87f6-4228-9dc1-c92ec3eed017 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:16:11.607587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f899e07a-87f6-4228-9dc1-c92ec3eed017 while it is in vm_state rescued Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:16:11.608821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:16:11.609976 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:16:11.609976 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:16:11.609976 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f899e07a-87f6-4228-9dc1-c92ec3eed017 while it is in vm_state rescued Aug 05 07:16:11.609976 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:16:11.609976 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-526fd390-c2aa-4740-aea4-5cda005d2263 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Returning 409 to user: Cannot 'attach_volume' instance f899e07a-87f6-4228-9dc1-c92ec3eed017 while it is in vm_state rescued {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:16:11.609976 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-526fd390-c2aa-4740-aea4-5cda005d2263 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "POST /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047913 Aug 05 07:16:11.609976 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 147/307] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:16:11 2022] POST /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 07:16:11.610465 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-baae729f-8d61-4505-bf79-58f2c1544a86 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:11.610465 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-baae729f-8d61-4505-bf79-58f2c1544a86 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:11.610465 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-baae729f-8d61-4505-bf79-58f2c1544a86 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:11.610465 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-baae729f-8d61-4505-bf79-58f2c1544a86 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:11.610737 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-baae729f-8d61-4505-bf79-58f2c1544a86 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:11.610737 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-baae729f-8d61-4505-bf79-58f2c1544a86 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:11.613050 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7d71ac7d-2752-4b95-8cd4-52cf45cdde81 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:16:11.613736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7d71ac7d-2752-4b95-8cd4-52cf45cdde81 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:11.621605 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d71ac7d-2752-4b95-8cd4-52cf45cdde81 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:11.622130 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d71ac7d-2752-4b95-8cd4-52cf45cdde81 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:11.622598 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d71ac7d-2752-4b95-8cd4-52cf45cdde81 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:11.623393 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d71ac7d-2752-4b95-8cd4-52cf45cdde81 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:11.623847 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d71ac7d-2752-4b95-8cd4-52cf45cdde81 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:11.624268 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d71ac7d-2752-4b95-8cd4-52cf45cdde81 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:11.706140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7d71ac7d-2752-4b95-8cd4-52cf45cdde81 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "POST /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017/action" status: 202 len: 0 microversion: 2.1 time: 0.097372 Aug 05 07:16:11.709923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 148/308] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:16:11 2022] POST /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:16:11.715868 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-272d28f1-87d9-421e-a35f-3af2e646c3ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:11.716607 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-272d28f1-87d9-421e-a35f-3af2e646c3ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:11.728478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-272d28f1-87d9-421e-a35f-3af2e646c3ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:11.729068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-272d28f1-87d9-421e-a35f-3af2e646c3ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:11.729573 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-272d28f1-87d9-421e-a35f-3af2e646c3ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:11.730354 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-272d28f1-87d9-421e-a35f-3af2e646c3ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:11.730805 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-272d28f1-87d9-421e-a35f-3af2e646c3ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:11.731222 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-272d28f1-87d9-421e-a35f-3af2e646c3ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:11.799822 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-baae729f-8d61-4505-bf79-58f2c1544a86 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:11.808067 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-baae729f-8d61-4505-bf79-58f2c1544a86 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:11.809615 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-baae729f-8d61-4505-bf79-58f2c1544a86 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:11.810759 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-baae729f-8d61-4505-bf79-58f2c1544a86 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.218650 Aug 05 07:16:11.811320 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 161/309] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:11 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:16:11.871459 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-272d28f1-87d9-421e-a35f-3af2e646c3ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:11.879430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-272d28f1-87d9-421e-a35f-3af2e646c3ce tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1511 microversion: 2.1 time: 0.168216 Aug 05 07:16:11.879992 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 149/310] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:11 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:16:12.833947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-35c8c28b-6cc1-48a4-a117-41ea79c20b06 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:12.835214 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-35c8c28b-6cc1-48a4-a117-41ea79c20b06 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:12.842308 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-35c8c28b-6cc1-48a4-a117-41ea79c20b06 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:12.842856 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-35c8c28b-6cc1-48a4-a117-41ea79c20b06 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:12.843528 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-35c8c28b-6cc1-48a4-a117-41ea79c20b06 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:12.844234 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-35c8c28b-6cc1-48a4-a117-41ea79c20b06 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:12.844687 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-35c8c28b-6cc1-48a4-a117-41ea79c20b06 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:12.845132 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-35c8c28b-6cc1-48a4-a117-41ea79c20b06 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:12.900042 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8bd630a5-4d16-4086-9bb1-d29c49e1586a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:12.901095 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8bd630a5-4d16-4086-9bb1-d29c49e1586a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:12.908094 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8bd630a5-4d16-4086-9bb1-d29c49e1586a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:12.909002 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8bd630a5-4d16-4086-9bb1-d29c49e1586a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:12.909665 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8bd630a5-4d16-4086-9bb1-d29c49e1586a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:12.910418 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8bd630a5-4d16-4086-9bb1-d29c49e1586a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:12.910867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8bd630a5-4d16-4086-9bb1-d29c49e1586a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:12.911289 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8bd630a5-4d16-4086-9bb1-d29c49e1586a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:13.016630 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-35c8c28b-6cc1-48a4-a117-41ea79c20b06 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:13.029578 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-35c8c28b-6cc1-48a4-a117-41ea79c20b06 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:13.036382 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-35c8c28b-6cc1-48a4-a117-41ea79c20b06 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:13.037713 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-35c8c28b-6cc1-48a4-a117-41ea79c20b06 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.207782 Aug 05 07:16:13.038622 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 162/311] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:12 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:16:13.087947 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8bd630a5-4d16-4086-9bb1-d29c49e1586a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:13.096191 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8bd630a5-4d16-4086-9bb1-d29c49e1586a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1511 microversion: 2.1 time: 0.200270 Aug 05 07:16:13.096995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 150/312] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:12 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:16:14.062204 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1fba2ad0-7bbd-47f9-97fa-99c6a24e0fc3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:14.062790 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1fba2ad0-7bbd-47f9-97fa-99c6a24e0fc3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:14.069625 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1fba2ad0-7bbd-47f9-97fa-99c6a24e0fc3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:14.070097 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1fba2ad0-7bbd-47f9-97fa-99c6a24e0fc3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:14.070540 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1fba2ad0-7bbd-47f9-97fa-99c6a24e0fc3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:14.071211 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1fba2ad0-7bbd-47f9-97fa-99c6a24e0fc3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:14.071653 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1fba2ad0-7bbd-47f9-97fa-99c6a24e0fc3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:14.072079 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1fba2ad0-7bbd-47f9-97fa-99c6a24e0fc3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:14.119506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-99e84b0d-0616-4a8f-bba8-9630d8058ba3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:14.120177 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-99e84b0d-0616-4a8f-bba8-9630d8058ba3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:14.127041 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-99e84b0d-0616-4a8f-bba8-9630d8058ba3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:14.127524 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-99e84b0d-0616-4a8f-bba8-9630d8058ba3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:14.127954 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-99e84b0d-0616-4a8f-bba8-9630d8058ba3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:14.128633 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-99e84b0d-0616-4a8f-bba8-9630d8058ba3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:14.129095 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-99e84b0d-0616-4a8f-bba8-9630d8058ba3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:14.129537 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-99e84b0d-0616-4a8f-bba8-9630d8058ba3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:14.232426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1fba2ad0-7bbd-47f9-97fa-99c6a24e0fc3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:14.241652 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1fba2ad0-7bbd-47f9-97fa-99c6a24e0fc3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:14.243559 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1fba2ad0-7bbd-47f9-97fa-99c6a24e0fc3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:14.244741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1fba2ad0-7bbd-47f9-97fa-99c6a24e0fc3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1406 microversion: 2.20 time: 0.187022 Aug 05 07:16:14.272955 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 163/313] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:14 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:16:14.283749 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-99e84b0d-0616-4a8f-bba8-9630d8058ba3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:14.294292 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-99e84b0d-0616-4a8f-bba8-9630d8058ba3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1511 microversion: 2.1 time: 0.179072 Aug 05 07:16:14.294980 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 151/314] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:14 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:15.272143 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-cf20e5bb-d4a7-4bc0-a7b9-45d227a0f3aa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:15.272504 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-cf20e5bb-d4a7-4bc0-a7b9-45d227a0f3aa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:15.279395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cf20e5bb-d4a7-4bc0-a7b9-45d227a0f3aa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:15.280050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cf20e5bb-d4a7-4bc0-a7b9-45d227a0f3aa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:15.280490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cf20e5bb-d4a7-4bc0-a7b9-45d227a0f3aa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:15.281350 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cf20e5bb-d4a7-4bc0-a7b9-45d227a0f3aa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:15.281810 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cf20e5bb-d4a7-4bc0-a7b9-45d227a0f3aa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:15.282214 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cf20e5bb-d4a7-4bc0-a7b9-45d227a0f3aa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:15.315832 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6bc66507-6bda-4b53-bb36-4498e3db83b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:15.316608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6bc66507-6bda-4b53-bb36-4498e3db83b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:15.323811 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6bc66507-6bda-4b53-bb36-4498e3db83b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:15.324436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6bc66507-6bda-4b53-bb36-4498e3db83b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:15.324989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6bc66507-6bda-4b53-bb36-4498e3db83b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:15.325799 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6bc66507-6bda-4b53-bb36-4498e3db83b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:15.326424 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6bc66507-6bda-4b53-bb36-4498e3db83b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:15.327296 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6bc66507-6bda-4b53-bb36-4498e3db83b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:15.440485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cf20e5bb-d4a7-4bc0-a7b9-45d227a0f3aa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:15.449026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cf20e5bb-d4a7-4bc0-a7b9-45d227a0f3aa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:15.450557 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cf20e5bb-d4a7-4bc0-a7b9-45d227a0f3aa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:15.451822 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-cf20e5bb-d4a7-4bc0-a7b9-45d227a0f3aa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1598 microversion: 2.20 time: 0.185465 Aug 05 07:16:15.452379 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 164/315] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:16:15 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1598 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:16:15.474715 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b2fc5499-f2dd-4448-8b7c-70fe3a64e30c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:15.475514 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b2fc5499-f2dd-4448-8b7c-70fe3a64e30c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:15.482282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b2fc5499-f2dd-4448-8b7c-70fe3a64e30c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:15.482800 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b2fc5499-f2dd-4448-8b7c-70fe3a64e30c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:15.483282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b2fc5499-f2dd-4448-8b7c-70fe3a64e30c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:15.484054 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b2fc5499-f2dd-4448-8b7c-70fe3a64e30c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:15.484709 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b2fc5499-f2dd-4448-8b7c-70fe3a64e30c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:15.485383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b2fc5499-f2dd-4448-8b7c-70fe3a64e30c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:15.494447 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6bc66507-6bda-4b53-bb36-4498e3db83b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:15.502588 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6bc66507-6bda-4b53-bb36-4498e3db83b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1511 microversion: 2.1 time: 0.190730 Aug 05 07:16:15.504933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 152/316] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:15 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:15.590151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b2fc5499-f2dd-4448-8b7c-70fe3a64e30c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.119969 Aug 05 07:16:15.590744 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 165/317] 10.222.0.27 () {60 vars in 1316 bytes} [Fri Aug 5 07:16:15 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 07:16:16.526416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9b86f5f1-f680-4d43-bda9-8bda57ae8dec tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:16.529127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9b86f5f1-f680-4d43-bda9-8bda57ae8dec tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:16.536503 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b86f5f1-f680-4d43-bda9-8bda57ae8dec tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:16.537362 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b86f5f1-f680-4d43-bda9-8bda57ae8dec tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:16.537945 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b86f5f1-f680-4d43-bda9-8bda57ae8dec tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:16.538795 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b86f5f1-f680-4d43-bda9-8bda57ae8dec tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:16.539389 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b86f5f1-f680-4d43-bda9-8bda57ae8dec tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:16.539974 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b86f5f1-f680-4d43-bda9-8bda57ae8dec tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:16.700255 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9b86f5f1-f680-4d43-bda9-8bda57ae8dec tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:16.708507 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9b86f5f1-f680-4d43-bda9-8bda57ae8dec tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1511 microversion: 2.1 time: 0.186118 Aug 05 07:16:16.715123 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 153/318] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:16 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:16.974756 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-0ec2cdfd-da4c-4027-96ef-48fa47f5fc0d req-b64ff019-27e3-45e2-b5fa-c3b188c88e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f664511a-28db-4ff6-90e9-7e2db58e94e2", "tag": "986a1785-c18c-444a-af3e-101b2ea68ae7"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:16:16.985154 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-0ec2cdfd-da4c-4027-96ef-48fa47f5fc0d req-b64ff019-27e3-45e2-b5fa-c3b188c88e94 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:16.985653 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-0ec2cdfd-da4c-4027-96ef-48fa47f5fc0d req-b64ff019-27e3-45e2-b5fa-c3b188c88e94 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:16.986071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-0ec2cdfd-da4c-4027-96ef-48fa47f5fc0d req-b64ff019-27e3-45e2-b5fa-c3b188c88e94 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:16.998724 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-0ec2cdfd-da4c-4027-96ef-48fa47f5fc0d req-b64ff019-27e3-45e2-b5fa-c3b188c88e94 service nova] Creating event network-changed:986a1785-c18c-444a-af3e-101b2ea68ae7 for instance f664511a-28db-4ff6-90e9-7e2db58e94e2 on hv-cinder-85200 Aug 05 07:16:17.004184 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-0ec2cdfd-da4c-4027-96ef-48fa47f5fc0d req-b64ff019-27e3-45e2-b5fa-c3b188c88e94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033065 Aug 05 07:16:17.008071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 166/319] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:16:17.734335 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d107645d-5ec6-465f-b396-1f20f54e7ab6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:17.735442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d107645d-5ec6-465f-b396-1f20f54e7ab6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:17.745132 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d107645d-5ec6-465f-b396-1f20f54e7ab6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:17.745717 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d107645d-5ec6-465f-b396-1f20f54e7ab6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:17.746221 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d107645d-5ec6-465f-b396-1f20f54e7ab6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:17.747403 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d107645d-5ec6-465f-b396-1f20f54e7ab6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:17.747935 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d107645d-5ec6-465f-b396-1f20f54e7ab6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:17.749264 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d107645d-5ec6-465f-b396-1f20f54e7ab6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:17.912635 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d107645d-5ec6-465f-b396-1f20f54e7ab6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:17.921905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d107645d-5ec6-465f-b396-1f20f54e7ab6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1511 microversion: 2.1 time: 0.196070 Aug 05 07:16:17.922809 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 154/320] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:17 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:18.943499 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-90154b57-705a-4c1b-96b4-9aac6108e994 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:18.944864 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-90154b57-705a-4c1b-96b4-9aac6108e994 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:18.951998 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-90154b57-705a-4c1b-96b4-9aac6108e994 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:18.952491 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-90154b57-705a-4c1b-96b4-9aac6108e994 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:18.952956 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-90154b57-705a-4c1b-96b4-9aac6108e994 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:18.953912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-90154b57-705a-4c1b-96b4-9aac6108e994 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:18.954533 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-90154b57-705a-4c1b-96b4-9aac6108e994 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:18.955143 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-90154b57-705a-4c1b-96b4-9aac6108e994 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:19.103580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-90154b57-705a-4c1b-96b4-9aac6108e994 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:19.111686 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-90154b57-705a-4c1b-96b4-9aac6108e994 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1517 microversion: 2.1 time: 0.172661 Aug 05 07:16:19.112269 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 167/321] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:18 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:20.508710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-261d4144-e4ab-4f5e-8801-4abbf9b22c26 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Action: 'create', calling method: .version_select at 0x7f497270faf0>, body: {"keypair": {"name": "tempest-keypair-1517680783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPvElKjHPLVkKEmsPt9EaNN27Y2JHPgsLHYlm/OfZsTB9vbsqkgR9pmN4z+K1PwRvSkW4jZCq9uwVhJgZj6y7hfS2fJ8IQXTDTsgsNjhygnL4orL0ZYlFrlR4KppU8fHQ=="}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:16:20.532174 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-261d4144-e4ab-4f5e-8801-4abbf9b22c26 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Getting quotas for project fe39edf907ff48518759474a800b949d. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:16:20.536354 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-261d4144-e4ab-4f5e-8801-4abbf9b22c26 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Getting quotas for user 2ce8bf4f0ab64010b3855193f55971d2 and project fe39edf907ff48518759474a800b949d. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:16:20.573713 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-261d4144-e4ab-4f5e-8801-4abbf9b22c26 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070173 Aug 05 07:16:20.574328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 155/322] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 5 07:16:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:16:21.954080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-962482833", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18d11307-47f7-43be-968f-d57a0e95c587"}], "security_groups": [{"name": "tempest-securitygroup--1779315550"}], "key_name": "tempest-keypair-1517680783", "user_data": "}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:16:21.962203 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:22.060086 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] validate_networks() for [('18d11307-47f7-43be-968f-d57a0e95c587', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:16:22.455034 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:16:22.455460 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:16:22.455923 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:16:22.456355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:16:22.456709 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:16:22.466408 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:22.466893 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:22.467326 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:22.468052 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:22.468565 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:22.468955 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:22.488625 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Getting quotas for project fe39edf907ff48518759474a800b949d. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:16:22.493289 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Getting quotas for user 2ce8bf4f0ab64010b3855193f55971d2 and project fe39edf907ff48518759474a800b949d. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:16:22.506361 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:16:22.508650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:16:22.559876 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-abdcdce9-7783-466f-8783-67b2b7224d54 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.610124 Aug 05 07:16:22.560812 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 168/323] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:16:21 2022] POST /compute/v2.1/servers => generated 409 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:16:22.572089 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1bdac9a1-0746-4143-95b6-91302d825832 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:22.572828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1bdac9a1-0746-4143-95b6-91302d825832 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:22.629139 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1bdac9a1-0746-4143-95b6-91302d825832 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:22.644507 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1bdac9a1-0746-4143-95b6-91302d825832 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1245 microversion: 2.1 time: 0.068403 Aug 05 07:16:22.644507 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 156/324] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:22 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:23.659518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e5d22518-59e6-4886-bfba-54aede8db8de tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:23.660177 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e5d22518-59e6-4886-bfba-54aede8db8de tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:23.669490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e5d22518-59e6-4886-bfba-54aede8db8de tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:23.670073 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e5d22518-59e6-4886-bfba-54aede8db8de tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:23.670511 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e5d22518-59e6-4886-bfba-54aede8db8de tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:23.671210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e5d22518-59e6-4886-bfba-54aede8db8de tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:23.671645 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e5d22518-59e6-4886-bfba-54aede8db8de tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:23.672093 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e5d22518-59e6-4886-bfba-54aede8db8de tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:23.741841 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e5d22518-59e6-4886-bfba-54aede8db8de tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:23.749648 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e5d22518-59e6-4886-bfba-54aede8db8de tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1297 microversion: 2.1 time: 0.096229 Aug 05 07:16:23.750242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 169/325] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:23 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:24.775127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9a1efadb-7306-4d7b-a397-0a1a74d61e23 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:24.776879 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9a1efadb-7306-4d7b-a397-0a1a74d61e23 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:24.786666 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a1efadb-7306-4d7b-a397-0a1a74d61e23 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:24.787560 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a1efadb-7306-4d7b-a397-0a1a74d61e23 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:24.788075 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a1efadb-7306-4d7b-a397-0a1a74d61e23 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:24.789132 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a1efadb-7306-4d7b-a397-0a1a74d61e23 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:24.789689 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a1efadb-7306-4d7b-a397-0a1a74d61e23 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:24.790013 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a1efadb-7306-4d7b-a397-0a1a74d61e23 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:24.964734 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9a1efadb-7306-4d7b-a397-0a1a74d61e23 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:24.979217 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9a1efadb-7306-4d7b-a397-0a1a74d61e23 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1371 microversion: 2.1 time: 0.207688 Aug 05 07:16:24.980951 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 157/326] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:24 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:25.394648 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-ec8858ff-e1fd-4d48-af38-0c3c14500c58 req-b3682f78-1c70-4f9c-b9ca-e1af6ee37598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d20686-267a-4bf7-b36b-7a248b0c3d8d", "tag": "08518c24-70ef-4c17-a240-418e5eae2128"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:16:25.408718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-ec8858ff-e1fd-4d48-af38-0c3c14500c58 req-b3682f78-1c70-4f9c-b9ca-e1af6ee37598 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:25.409836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-ec8858ff-e1fd-4d48-af38-0c3c14500c58 req-b3682f78-1c70-4f9c-b9ca-e1af6ee37598 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:25.410744 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-ec8858ff-e1fd-4d48-af38-0c3c14500c58 req-b3682f78-1c70-4f9c-b9ca-e1af6ee37598 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:25.426925 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-ec8858ff-e1fd-4d48-af38-0c3c14500c58 req-b3682f78-1c70-4f9c-b9ca-e1af6ee37598 service nova] Creating event network-changed:08518c24-70ef-4c17-a240-418e5eae2128 for instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d on hv-cinder-85200 Aug 05 07:16:25.433015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-ec8858ff-e1fd-4d48-af38-0c3c14500c58 req-b3682f78-1c70-4f9c-b9ca-e1af6ee37598 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042943 Aug 05 07:16:25.434152 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 170/327] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:16:26.001387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-097285bf-7d54-432b-a96a-46971b9d76a1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:26.002217 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-097285bf-7d54-432b-a96a-46971b9d76a1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:26.012212 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-097285bf-7d54-432b-a96a-46971b9d76a1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:26.013699 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-097285bf-7d54-432b-a96a-46971b9d76a1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:26.014550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-097285bf-7d54-432b-a96a-46971b9d76a1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:26.015141 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-097285bf-7d54-432b-a96a-46971b9d76a1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:26.016325 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-097285bf-7d54-432b-a96a-46971b9d76a1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:26.016854 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-097285bf-7d54-432b-a96a-46971b9d76a1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:26.191256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-097285bf-7d54-432b-a96a-46971b9d76a1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:26.201251 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-097285bf-7d54-432b-a96a-46971b9d76a1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1371 microversion: 2.1 time: 0.203640 Aug 05 07:16:26.201867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 158/328] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:25 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:27.223599 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-fb565efb-b613-4a91-ade7-bfcabd8b23dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:27.224334 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-fb565efb-b613-4a91-ade7-bfcabd8b23dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:27.231161 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fb565efb-b613-4a91-ade7-bfcabd8b23dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:27.231644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fb565efb-b613-4a91-ade7-bfcabd8b23dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:27.232075 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fb565efb-b613-4a91-ade7-bfcabd8b23dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:27.232765 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fb565efb-b613-4a91-ade7-bfcabd8b23dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:27.233263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fb565efb-b613-4a91-ade7-bfcabd8b23dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:27.233670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fb565efb-b613-4a91-ade7-bfcabd8b23dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:27.365264 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-fb565efb-b613-4a91-ade7-bfcabd8b23dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:27.373812 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-fb565efb-b613-4a91-ade7-bfcabd8b23dc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1371 microversion: 2.1 time: 0.154460 Aug 05 07:16:27.375173 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 171/329] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:27 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:28.396882 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d9b83a93-4bd8-413d-8720-2ae642ebd10c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:28.397564 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d9b83a93-4bd8-413d-8720-2ae642ebd10c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:28.407545 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9b83a93-4bd8-413d-8720-2ae642ebd10c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:28.408241 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9b83a93-4bd8-413d-8720-2ae642ebd10c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:28.408817 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9b83a93-4bd8-413d-8720-2ae642ebd10c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:28.409889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9b83a93-4bd8-413d-8720-2ae642ebd10c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:28.410254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9b83a93-4bd8-413d-8720-2ae642ebd10c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:28.410827 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9b83a93-4bd8-413d-8720-2ae642ebd10c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:28.552377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d9b83a93-4bd8-413d-8720-2ae642ebd10c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:28.560755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d9b83a93-4bd8-413d-8720-2ae642ebd10c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1371 microversion: 2.1 time: 0.168363 Aug 05 07:16:28.561798 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 159/330] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:28 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:29.585558 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5ce09078-0577-4e5e-929f-09fc76976b6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:29.586798 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5ce09078-0577-4e5e-929f-09fc76976b6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:29.593048 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5ce09078-0577-4e5e-929f-09fc76976b6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:29.593529 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5ce09078-0577-4e5e-929f-09fc76976b6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:29.593950 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5ce09078-0577-4e5e-929f-09fc76976b6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:29.594628 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5ce09078-0577-4e5e-929f-09fc76976b6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:29.595079 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5ce09078-0577-4e5e-929f-09fc76976b6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:29.595495 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5ce09078-0577-4e5e-929f-09fc76976b6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:29.822881 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5ce09078-0577-4e5e-929f-09fc76976b6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:29.831624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5ce09078-0577-4e5e-929f-09fc76976b6b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1371 microversion: 2.1 time: 0.249848 Aug 05 07:16:29.842516 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 172/331] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:29 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:30.853059 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-704a2f09-27bc-4ac3-b48c-e1f977f5fde7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:30.853673 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-704a2f09-27bc-4ac3-b48c-e1f977f5fde7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:30.860592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-704a2f09-27bc-4ac3-b48c-e1f977f5fde7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:30.861120 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-704a2f09-27bc-4ac3-b48c-e1f977f5fde7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:30.861624 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-704a2f09-27bc-4ac3-b48c-e1f977f5fde7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:30.862264 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-704a2f09-27bc-4ac3-b48c-e1f977f5fde7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:30.862747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-704a2f09-27bc-4ac3-b48c-e1f977f5fde7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:30.863165 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-704a2f09-27bc-4ac3-b48c-e1f977f5fde7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:31.004453 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-704a2f09-27bc-4ac3-b48c-e1f977f5fde7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:31.012446 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-704a2f09-27bc-4ac3-b48c-e1f977f5fde7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1371 microversion: 2.1 time: 0.163249 Aug 05 07:16:31.024956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 160/332] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:30 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:32.034736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-91abce7f-09f7-47a8-9a4a-e501c436a619 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:32.035377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-91abce7f-09f7-47a8-9a4a-e501c436a619 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:32.041877 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91abce7f-09f7-47a8-9a4a-e501c436a619 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:32.042354 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91abce7f-09f7-47a8-9a4a-e501c436a619 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:32.042777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91abce7f-09f7-47a8-9a4a-e501c436a619 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:32.043452 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91abce7f-09f7-47a8-9a4a-e501c436a619 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:32.043895 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91abce7f-09f7-47a8-9a4a-e501c436a619 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:32.044314 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91abce7f-09f7-47a8-9a4a-e501c436a619 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:32.186580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-91abce7f-09f7-47a8-9a4a-e501c436a619 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:32.194337 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-91abce7f-09f7-47a8-9a4a-e501c436a619 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1371 microversion: 2.1 time: 0.163482 Aug 05 07:16:32.195261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 173/333] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:32 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:33.145334 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-52313d33-0def-4afa-8d3c-ff29b8b2b5aa req-a7d189be-cfc1-459a-b1d6-696b2eb37016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d20686-267a-4bf7-b36b-7a248b0c3d8d", "name": "network-vif-plugged", "status": "completed", "tag": "08518c24-70ef-4c17-a240-418e5eae2128"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:16:33.154118 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:33.161924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-52313d33-0def-4afa-8d3c-ff29b8b2b5aa req-a7d189be-cfc1-459a-b1d6-696b2eb37016 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:33.162396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-52313d33-0def-4afa-8d3c-ff29b8b2b5aa req-a7d189be-cfc1-459a-b1d6-696b2eb37016 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:33.162823 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-52313d33-0def-4afa-8d3c-ff29b8b2b5aa req-a7d189be-cfc1-459a-b1d6-696b2eb37016 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:33.173987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-52313d33-0def-4afa-8d3c-ff29b8b2b5aa req-a7d189be-cfc1-459a-b1d6-696b2eb37016 service nova] Creating event network-vif-plugged:08518c24-70ef-4c17-a240-418e5eae2128 for instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d on hv-cinder-85200 Aug 05 07:16:33.179128 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-52313d33-0def-4afa-8d3c-ff29b8b2b5aa req-a7d189be-cfc1-459a-b1d6-696b2eb37016 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037769 Aug 05 07:16:33.179735 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 161/334] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:16:33.215718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d03fd486-e337-4de6-9465-d44fae72fddd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:33.216395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d03fd486-e337-4de6-9465-d44fae72fddd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:33.218414 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:33.219037 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=6 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:33.226220 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d03fd486-e337-4de6-9465-d44fae72fddd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:33.226706 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d03fd486-e337-4de6-9465-d44fae72fddd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:33.227133 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d03fd486-e337-4de6-9465-d44fae72fddd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:33.227829 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d03fd486-e337-4de6-9465-d44fae72fddd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:33.228271 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d03fd486-e337-4de6-9465-d44fae72fddd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:33.228681 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d03fd486-e337-4de6-9465-d44fae72fddd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:33.379393 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d03fd486-e337-4de6-9465-d44fae72fddd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:33.387761 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d03fd486-e337-4de6-9465-d44fae72fddd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1371 microversion: 2.1 time: 0.175955 Aug 05 07:16:33.388752 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 174/335] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:33 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:34.409942 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-52f6dbe7-1c78-489b-ab6b-6cd4b95e48ef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:34.410672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-52f6dbe7-1c78-489b-ab6b-6cd4b95e48ef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:34.417828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-52f6dbe7-1c78-489b-ab6b-6cd4b95e48ef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:34.418287 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-52f6dbe7-1c78-489b-ab6b-6cd4b95e48ef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:34.418971 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-52f6dbe7-1c78-489b-ab6b-6cd4b95e48ef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:34.419657 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-52f6dbe7-1c78-489b-ab6b-6cd4b95e48ef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:34.420103 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-52f6dbe7-1c78-489b-ab6b-6cd4b95e48ef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:34.420517 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-52f6dbe7-1c78-489b-ab6b-6cd4b95e48ef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:34.561929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-52f6dbe7-1c78-489b-ab6b-6cd4b95e48ef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:34.565514 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:34.570419 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-52f6dbe7-1c78-489b-ab6b-6cd4b95e48ef tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1371 microversion: 2.1 time: 0.164715 Aug 05 07:16:34.570994 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 162/336] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:34 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:35.591998 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ef5fbe17-3134-4f8c-8e60-820b38f7fdcc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:35.592611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ef5fbe17-3134-4f8c-8e60-820b38f7fdcc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:35.599946 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef5fbe17-3134-4f8c-8e60-820b38f7fdcc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:35.600460 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef5fbe17-3134-4f8c-8e60-820b38f7fdcc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:35.600871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef5fbe17-3134-4f8c-8e60-820b38f7fdcc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:35.601661 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef5fbe17-3134-4f8c-8e60-820b38f7fdcc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:35.604584 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef5fbe17-3134-4f8c-8e60-820b38f7fdcc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:35.605352 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef5fbe17-3134-4f8c-8e60-820b38f7fdcc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:35.741751 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ef5fbe17-3134-4f8c-8e60-820b38f7fdcc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:35.749268 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ef5fbe17-3134-4f8c-8e60-820b38f7fdcc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1371 microversion: 2.1 time: 0.161967 Aug 05 07:16:35.749840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 175/337] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:35 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:36.771084 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-30f028e4-8ce9-4beb-a0e4-5dde184392e7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:36.771664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-30f028e4-8ce9-4beb-a0e4-5dde184392e7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:36.779754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-30f028e4-8ce9-4beb-a0e4-5dde184392e7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:36.780210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-30f028e4-8ce9-4beb-a0e4-5dde184392e7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:36.780629 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-30f028e4-8ce9-4beb-a0e4-5dde184392e7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:36.781536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-30f028e4-8ce9-4beb-a0e4-5dde184392e7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:36.781996 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-30f028e4-8ce9-4beb-a0e4-5dde184392e7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:36.782390 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-30f028e4-8ce9-4beb-a0e4-5dde184392e7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:36.923372 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-30f028e4-8ce9-4beb-a0e4-5dde184392e7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:16:36.934170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-30f028e4-8ce9-4beb-a0e4-5dde184392e7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1566 microversion: 2.1 time: 0.167025 Aug 05 07:16:36.934910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 163/338] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:16:36 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:16:36.954492 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-66aa9b4c-6a61-45a4-b423-01698d22ef73 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:16:36.954996 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-66aa9b4c-6a61-45a4-b423-01698d22ef73 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:16:36.961311 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-66aa9b4c-6a61-45a4-b423-01698d22ef73 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:36.961788 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-66aa9b4c-6a61-45a4-b423-01698d22ef73 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:36.962219 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-66aa9b4c-6a61-45a4-b423-01698d22ef73 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:36.962899 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-66aa9b4c-6a61-45a4-b423-01698d22ef73 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:36.963347 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-66aa9b4c-6a61-45a4-b423-01698d22ef73 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:36.963766 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-66aa9b4c-6a61-45a4-b423-01698d22ef73 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:37.044497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-66aa9b4c-6a61-45a4-b423-01698d22ef73 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093894 Aug 05 07:16:37.045122 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 176/339] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 5 07:16:36 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:16:38.034425 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-a83136e9-7c7c-4d79-b923-5bfe3be91355 req-5fb32c1b-8c9c-42f7-b777-a8e062d20a9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d20686-267a-4bf7-b36b-7a248b0c3d8d", "tag": "08518c24-70ef-4c17-a240-418e5eae2128"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:16:38.039597 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:38.045092 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-a83136e9-7c7c-4d79-b923-5bfe3be91355 req-5fb32c1b-8c9c-42f7-b777-a8e062d20a9d service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:16:38.045776 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-a83136e9-7c7c-4d79-b923-5bfe3be91355 req-5fb32c1b-8c9c-42f7-b777-a8e062d20a9d service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:16:38.046182 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-a83136e9-7c7c-4d79-b923-5bfe3be91355 req-5fb32c1b-8c9c-42f7-b777-a8e062d20a9d service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:16:38.058741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-a83136e9-7c7c-4d79-b923-5bfe3be91355 req-5fb32c1b-8c9c-42f7-b777-a8e062d20a9d service nova] Creating event network-changed:08518c24-70ef-4c17-a240-418e5eae2128 for instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d on hv-cinder-85200 Aug 05 07:16:38.063824 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-a83136e9-7c7c-4d79-b923-5bfe3be91355 req-5fb32c1b-8c9c-42f7-b777-a8e062d20a9d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033168 Aug 05 07:16:38.064417 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 164/340] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:16:56.487167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:56.488624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=98 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:56.768092 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7fe5934a-c1e5-4fa3-bf73-900117a73ff5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Action: 'create', calling method: .version_select at 0x7f4971cdcd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1981702890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCItNG0bar0kOgAhGX/XiuCh+JstWp/GOnVEwcH5USZKnlFqsdLCPJmh/DL3k9/6Xdoh7L0wl4WAawAOonBEgZN+GkiQwpWoHtOEuGNo1702V9ETWHKfR6sxDYt2jVIzzQ=="}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:16:56.790317 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-7fe5934a-c1e5-4fa3-bf73-900117a73ff5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Getting quotas for project 2720b0660de14a19a05ef57efaa01cd8. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:16:56.796544 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-7fe5934a-c1e5-4fa3-bf73-900117a73ff5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Getting quotas for user 43ef613541cb4fd49faa3a3cec1a58c8 and project 2720b0660de14a19a05ef57efaa01cd8. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:16:56.827229 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7fe5934a-c1e5-4fa3-bf73-900117a73ff5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.344889 Aug 05 07:16:56.827993 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 177/341] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 5 07:16:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:11.061661 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=8 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:11.063161 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:11.068826 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9c002ee9-3e49-4d84-a771-73a2042ff4c3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:11.069513 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9c002ee9-3e49-4d84-a771-73a2042ff4c3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:11.076933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c002ee9-3e49-4d84-a771-73a2042ff4c3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:11.077445 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c002ee9-3e49-4d84-a771-73a2042ff4c3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:11.077867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c002ee9-3e49-4d84-a771-73a2042ff4c3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:11.078556 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c002ee9-3e49-4d84-a771-73a2042ff4c3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:11.078996 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c002ee9-3e49-4d84-a771-73a2042ff4c3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:11.079401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c002ee9-3e49-4d84-a771-73a2042ff4c3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:11.103587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9c002ee9-3e49-4d84-a771-73a2042ff4c3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/ips" status: 200 len: 145 microversion: 2.1 time: 0.044566 Aug 05 07:17:11.104158 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 165/342] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 5 07:17:11 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:17.489897 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=4 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:17.490690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:17.495309 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0be36d27-9440-457c-bea3-6212c2165577 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2aa5110b-f035-4f97-a186-28dcf3726c54"}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:17.498002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0be36d27-9440-457c-bea3-6212c2165577 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:17.505782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0be36d27-9440-457c-bea3-6212c2165577 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:17.506272 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0be36d27-9440-457c-bea3-6212c2165577 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:17.506718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0be36d27-9440-457c-bea3-6212c2165577 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:17.507417 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0be36d27-9440-457c-bea3-6212c2165577 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:17.507879 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0be36d27-9440-457c-bea3-6212c2165577 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:17.508298 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0be36d27-9440-457c-bea3-6212c2165577 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:17.836588 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0be36d27-9440-457c-bea3-6212c2165577 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "POST /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347455 Aug 05 07:17:17.837235 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 178/343] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:17:17 2022] POST /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:18.819668 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eb74c8db-e8bd-49fe-8620-fc044ecc0edf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:18.820285 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-eb74c8db-e8bd-49fe-8620-fc044ecc0edf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:18.827643 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb74c8db-e8bd-49fe-8620-fc044ecc0edf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:18.828165 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb74c8db-e8bd-49fe-8620-fc044ecc0edf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:18.828638 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb74c8db-e8bd-49fe-8620-fc044ecc0edf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:18.829425 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb74c8db-e8bd-49fe-8620-fc044ecc0edf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:18.829910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb74c8db-e8bd-49fe-8620-fc044ecc0edf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:18.830371 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb74c8db-e8bd-49fe-8620-fc044ecc0edf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:18.855324 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-eb74c8db-e8bd-49fe-8620-fc044ecc0edf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/ips" status: 200 len: 149 microversion: 2.1 time: 0.040228 Aug 05 07:17:18.855881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 166/344] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 5 07:17:18 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:21.310430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-10d67339-b762-468a-ab41-a257394ba514 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03292344-940a-4280-8d04-9c62310c3f9c"}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:21.313045 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-10d67339-b762-468a-ab41-a257394ba514 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:21.460680 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10d67339-b762-468a-ab41-a257394ba514 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:21.461179 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10d67339-b762-468a-ab41-a257394ba514 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:21.461623 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10d67339-b762-468a-ab41-a257394ba514 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:21.462353 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10d67339-b762-468a-ab41-a257394ba514 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:21.462796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10d67339-b762-468a-ab41-a257394ba514 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:21.463196 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10d67339-b762-468a-ab41-a257394ba514 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:21.792380 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-10d67339-b762-468a-ab41-a257394ba514 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489740 Aug 05 07:17:21.793514 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 179/345] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:17:21 2022] POST /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:22.947658 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-450318691", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1981702890", "security_groups": [{"name": "tempest-secgroup-smoke-58290517"}], "block_device_mapping_v2": [{"uuid": "4ac81565-9d68-460e-93e9-81139bc1778f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "898bc1bf-853e-4d5f-beef-8e86d982e4a4"}]}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:23.070016 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] validate_networks() for [('898bc1bf-853e-4d5f-beef-8e86d982e4a4', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:17:23.466143 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:17:23.466801 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:17:23.467542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:17:23.468115 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:17:23.468728 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:17:23.483534 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:23.484196 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:23.484771 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:23.485857 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:23.486420 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:23.486995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:23.506698 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Getting quotas for project 2720b0660de14a19a05ef57efaa01cd8. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:17:23.512182 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Getting quotas for user 43ef613541cb4fd49faa3a3cec1a58c8 and project 2720b0660de14a19a05ef57efaa01cd8. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:17:23.581710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:17:23.583811 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4ac81565-9d68-460e-93e9-81139bc1778f',volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:17:23.724230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [9f5e4f0b-5cdc-4894-9cc7-f891dcbc3fa0] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 07:17:24.733874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [9f5e4f0b-5cdc-4894-9cc7-f891dcbc3fa0] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 50996. Aug 05 07:17:24.738682 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6f307692-a4f9-49ff-85d3-377802f2c580 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.797235 Aug 05 07:17:24.742945 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 167/346] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:17:22 2022] POST /compute/v2.1/servers => generated 404 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:17:24.750899 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-255fc491-29de-48f8-8bde-a9f978097213 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:24.751654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-255fc491-29de-48f8-8bde-a9f978097213 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:24.807235 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-255fc491-29de-48f8-8bde-a9f978097213 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:24.814129 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-255fc491-29de-48f8-8bde-a9f978097213 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1094 microversion: 2.1 time: 0.067419 Aug 05 07:17:24.814732 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 180/347] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:24 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:25.389310 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b0b7bebd-d9cc-4e38-99f5-7bc708ca21ad tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:25.395517 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b0b7bebd-d9cc-4e38-99f5-7bc708ca21ad tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:25.396007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b0b7bebd-d9cc-4e38-99f5-7bc708ca21ad tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:25.396433 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b0b7bebd-d9cc-4e38-99f5-7bc708ca21ad tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:25.456933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b0b7bebd-d9cc-4e38-99f5-7bc708ca21ad tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Going to try to stop instance {{(pid=117893) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 07:17:25.500841 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b0b7bebd-d9cc-4e38-99f5-7bc708ca21ad tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "POST /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/action" status: 202 len: 0 microversion: 2.1 time: 0.115859 Aug 05 07:17:25.501518 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 168/348] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:17:25 2022] POST /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:17:25.511392 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d9cc0b60-158d-46d7-910d-4286999ed5d9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:25.512099 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d9cc0b60-158d-46d7-910d-4286999ed5d9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:25.522318 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9cc0b60-158d-46d7-910d-4286999ed5d9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:25.522853 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9cc0b60-158d-46d7-910d-4286999ed5d9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:25.523330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9cc0b60-158d-46d7-910d-4286999ed5d9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:25.525330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9cc0b60-158d-46d7-910d-4286999ed5d9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:25.525746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9cc0b60-158d-46d7-910d-4286999ed5d9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:25.526317 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9cc0b60-158d-46d7-910d-4286999ed5d9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:25.668588 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d9cc0b60-158d-46d7-910d-4286999ed5d9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:25.679214 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d9cc0b60-158d-46d7-910d-4286999ed5d9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1724 microversion: 2.1 time: 0.172591 Aug 05 07:17:25.679792 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 181/349] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:25 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:25.837279 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9ceea98d-63ba-4789-8b7d-1e75591ac2aa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:25.837936 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9ceea98d-63ba-4789-8b7d-1e75591ac2aa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:25.846359 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ceea98d-63ba-4789-8b7d-1e75591ac2aa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:25.846839 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ceea98d-63ba-4789-8b7d-1e75591ac2aa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:25.847270 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ceea98d-63ba-4789-8b7d-1e75591ac2aa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:25.847969 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ceea98d-63ba-4789-8b7d-1e75591ac2aa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:25.848446 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ceea98d-63ba-4789-8b7d-1e75591ac2aa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:25.848860 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ceea98d-63ba-4789-8b7d-1e75591ac2aa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:25.917527 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9ceea98d-63ba-4789-8b7d-1e75591ac2aa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:25.929148 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9ceea98d-63ba-4789-8b7d-1e75591ac2aa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1192 microversion: 2.1 time: 0.097492 Aug 05 07:17:25.930156 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 169/350] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:25 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:26.700513 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-187e91bb-8721-42fb-80b5-8d689a9ac6f7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:26.701161 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-187e91bb-8721-42fb-80b5-8d689a9ac6f7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:26.707870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-187e91bb-8721-42fb-80b5-8d689a9ac6f7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:26.708348 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-187e91bb-8721-42fb-80b5-8d689a9ac6f7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:26.708795 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-187e91bb-8721-42fb-80b5-8d689a9ac6f7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:26.709528 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-187e91bb-8721-42fb-80b5-8d689a9ac6f7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:26.709966 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-187e91bb-8721-42fb-80b5-8d689a9ac6f7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:26.710368 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-187e91bb-8721-42fb-80b5-8d689a9ac6f7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:26.881948 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-187e91bb-8721-42fb-80b5-8d689a9ac6f7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:26.890723 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-187e91bb-8721-42fb-80b5-8d689a9ac6f7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1724 microversion: 2.1 time: 0.194297 Aug 05 07:17:26.891308 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 182/351] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:26 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:26.963569 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4c82b393-a8a8-4a53-9a07-21550728f1de tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:26.964933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4c82b393-a8a8-4a53-9a07-21550728f1de tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:26.971850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4c82b393-a8a8-4a53-9a07-21550728f1de tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:26.972427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4c82b393-a8a8-4a53-9a07-21550728f1de tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:26.972805 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4c82b393-a8a8-4a53-9a07-21550728f1de tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:26.973663 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4c82b393-a8a8-4a53-9a07-21550728f1de tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:26.974109 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4c82b393-a8a8-4a53-9a07-21550728f1de tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:26.974524 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4c82b393-a8a8-4a53-9a07-21550728f1de tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:27.043296 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4c82b393-a8a8-4a53-9a07-21550728f1de tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:27.053433 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4c82b393-a8a8-4a53-9a07-21550728f1de tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1210 microversion: 2.1 time: 0.093547 Aug 05 07:17:27.054272 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 170/352] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:26 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:27.874050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-f1f78c0b-f713-43d4-8ebe-693924db35bb req-8546ce4b-5dc7-49b3-98d2-094d0466436a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8f14ba1-bb82-4edf-baf2-308048c6c67c", "tag": "7df94f6e-8c50-4ecc-aa16-ac32883658a4"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:27.886146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-f1f78c0b-f713-43d4-8ebe-693924db35bb req-8546ce4b-5dc7-49b3-98d2-094d0466436a service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:27.887103 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-f1f78c0b-f713-43d4-8ebe-693924db35bb req-8546ce4b-5dc7-49b3-98d2-094d0466436a service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:27.887573 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-f1f78c0b-f713-43d4-8ebe-693924db35bb req-8546ce4b-5dc7-49b3-98d2-094d0466436a service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:27.899253 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-f1f78c0b-f713-43d4-8ebe-693924db35bb req-8546ce4b-5dc7-49b3-98d2-094d0466436a service nova] Creating event network-changed:7df94f6e-8c50-4ecc-aa16-ac32883658a4 for instance b8f14ba1-bb82-4edf-baf2-308048c6c67c on hv-cinder-85200 Aug 05 07:17:27.904179 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-f1f78c0b-f713-43d4-8ebe-693924db35bb req-8546ce4b-5dc7-49b3-98d2-094d0466436a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034160 Aug 05 07:17:27.904863 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 183/353] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:27.912856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2dbae51a-ea2f-48a2-b2f2-2268b3ed7b69 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:27.913734 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2dbae51a-ea2f-48a2-b2f2-2268b3ed7b69 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:27.928437 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2dbae51a-ea2f-48a2-b2f2-2268b3ed7b69 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:27.929022 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2dbae51a-ea2f-48a2-b2f2-2268b3ed7b69 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:27.929551 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2dbae51a-ea2f-48a2-b2f2-2268b3ed7b69 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:27.930396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2dbae51a-ea2f-48a2-b2f2-2268b3ed7b69 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:27.930850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2dbae51a-ea2f-48a2-b2f2-2268b3ed7b69 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:27.931267 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2dbae51a-ea2f-48a2-b2f2-2268b3ed7b69 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:28.080433 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-31bc1516-c47f-4e9d-8731-bc94e5a17e8e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:28.081334 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-31bc1516-c47f-4e9d-8731-bc94e5a17e8e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:28.088389 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-31bc1516-c47f-4e9d-8731-bc94e5a17e8e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:28.088886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-31bc1516-c47f-4e9d-8731-bc94e5a17e8e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:28.089430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-31bc1516-c47f-4e9d-8731-bc94e5a17e8e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:28.090166 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-31bc1516-c47f-4e9d-8731-bc94e5a17e8e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:28.090619 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-31bc1516-c47f-4e9d-8731-bc94e5a17e8e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:28.091058 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-31bc1516-c47f-4e9d-8731-bc94e5a17e8e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:28.314904 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2dbae51a-ea2f-48a2-b2f2-2268b3ed7b69 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:28.323256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2dbae51a-ea2f-48a2-b2f2-2268b3ed7b69 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1724 microversion: 2.1 time: 0.414659 Aug 05 07:17:28.323860 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 171/354] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:27 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:28.552251 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-31bc1516-c47f-4e9d-8731-bc94e5a17e8e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:28.560059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-31bc1516-c47f-4e9d-8731-bc94e5a17e8e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1276 microversion: 2.1 time: 0.484295 Aug 05 07:17:28.560610 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 184/355] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:28 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1276 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:29.344123 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b6844584-57ec-4141-b482-00ff15686672 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:29.344690 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b6844584-57ec-4141-b482-00ff15686672 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:29.351597 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6844584-57ec-4141-b482-00ff15686672 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:29.352084 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6844584-57ec-4141-b482-00ff15686672 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:29.352522 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6844584-57ec-4141-b482-00ff15686672 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:29.353263 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6844584-57ec-4141-b482-00ff15686672 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:29.353723 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6844584-57ec-4141-b482-00ff15686672 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:29.354146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6844584-57ec-4141-b482-00ff15686672 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:29.486735 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b6844584-57ec-4141-b482-00ff15686672 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:29.495490 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b6844584-57ec-4141-b482-00ff15686672 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1724 microversion: 2.1 time: 0.155382 Aug 05 07:17:29.495974 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 172/356] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:29 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:29.580063 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-212bab32-aaa2-46df-ab0c-18430d6fb7d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:29.580620 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-212bab32-aaa2-46df-ab0c-18430d6fb7d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:29.587874 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-212bab32-aaa2-46df-ab0c-18430d6fb7d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:29.588388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-212bab32-aaa2-46df-ab0c-18430d6fb7d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:29.588819 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-212bab32-aaa2-46df-ab0c-18430d6fb7d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:29.589575 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-212bab32-aaa2-46df-ab0c-18430d6fb7d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:29.590025 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-212bab32-aaa2-46df-ab0c-18430d6fb7d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:29.590446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-212bab32-aaa2-46df-ab0c-18430d6fb7d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:29.740018 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-212bab32-aaa2-46df-ab0c-18430d6fb7d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:29.749843 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-212bab32-aaa2-46df-ab0c-18430d6fb7d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1276 microversion: 2.1 time: 0.173648 Aug 05 07:17:29.750408 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 185/357] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:29 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:30.518886 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7137bbcf-fc61-44c1-bf8e-5354530923f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:30.519716 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7137bbcf-fc61-44c1-bf8e-5354530923f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:30.528708 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7137bbcf-fc61-44c1-bf8e-5354530923f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:30.529396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7137bbcf-fc61-44c1-bf8e-5354530923f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:30.529828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7137bbcf-fc61-44c1-bf8e-5354530923f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:30.530519 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7137bbcf-fc61-44c1-bf8e-5354530923f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:30.530967 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7137bbcf-fc61-44c1-bf8e-5354530923f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:30.531391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7137bbcf-fc61-44c1-bf8e-5354530923f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:30.680190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7137bbcf-fc61-44c1-bf8e-5354530923f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:30.689012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7137bbcf-fc61-44c1-bf8e-5354530923f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1724 microversion: 2.1 time: 0.175035 Aug 05 07:17:30.689580 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 173/358] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:30 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:30.775557 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f37995af-f760-4a33-9d78-e603a2734fd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:30.776126 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f37995af-f760-4a33-9d78-e603a2734fd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:30.783203 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f37995af-f760-4a33-9d78-e603a2734fd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:30.783704 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f37995af-f760-4a33-9d78-e603a2734fd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:30.784140 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f37995af-f760-4a33-9d78-e603a2734fd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:30.784833 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f37995af-f760-4a33-9d78-e603a2734fd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:30.785321 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f37995af-f760-4a33-9d78-e603a2734fd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:30.785750 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f37995af-f760-4a33-9d78-e603a2734fd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:30.923089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f37995af-f760-4a33-9d78-e603a2734fd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:30.934990 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f37995af-f760-4a33-9d78-e603a2734fd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1276 microversion: 2.1 time: 0.164554 Aug 05 07:17:30.935760 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 186/359] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:30 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:31.710017 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-23f9a2cf-a8fd-47d6-b78b-09c248dcf378 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:31.710552 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-23f9a2cf-a8fd-47d6-b78b-09c248dcf378 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:31.719807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-23f9a2cf-a8fd-47d6-b78b-09c248dcf378 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:31.720478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-23f9a2cf-a8fd-47d6-b78b-09c248dcf378 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:31.721109 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-23f9a2cf-a8fd-47d6-b78b-09c248dcf378 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:31.721939 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-23f9a2cf-a8fd-47d6-b78b-09c248dcf378 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:31.722388 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-23f9a2cf-a8fd-47d6-b78b-09c248dcf378 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:31.722940 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-23f9a2cf-a8fd-47d6-b78b-09c248dcf378 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:31.856932 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-23f9a2cf-a8fd-47d6-b78b-09c248dcf378 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:31.865531 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-23f9a2cf-a8fd-47d6-b78b-09c248dcf378 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1724 microversion: 2.1 time: 0.159427 Aug 05 07:17:31.866115 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 174/360] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:31 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:31.964297 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-be8c3ad3-87a8-46ed-ac3e-4ae74eebf525 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:31.965116 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-be8c3ad3-87a8-46ed-ac3e-4ae74eebf525 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:31.972249 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be8c3ad3-87a8-46ed-ac3e-4ae74eebf525 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:31.972741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be8c3ad3-87a8-46ed-ac3e-4ae74eebf525 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:31.973206 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be8c3ad3-87a8-46ed-ac3e-4ae74eebf525 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:31.973903 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be8c3ad3-87a8-46ed-ac3e-4ae74eebf525 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:31.974357 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be8c3ad3-87a8-46ed-ac3e-4ae74eebf525 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:31.974781 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be8c3ad3-87a8-46ed-ac3e-4ae74eebf525 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:32.109341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-be8c3ad3-87a8-46ed-ac3e-4ae74eebf525 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:32.117972 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-be8c3ad3-87a8-46ed-ac3e-4ae74eebf525 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1276 microversion: 2.1 time: 0.159848 Aug 05 07:17:32.118545 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 187/361] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:31 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:32.544426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0f6c5b21-82f9-45e6-9f45-e847c735a59f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: .version_select at 0x7f4970b0fa60>, body: {"keypair": {"name": "tempest-keypair-1764988882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgwS/jU8GgN2yYLeP5Amsv6Rd1hKlmZo93c9T3Gu+hd1tGY6xMAs92FWYF7FWx8zHCMtmW/ntuXnkxe7VD7RqTOQf+K2G3iNu65/7gcpE5CHI6/UQ9vH+7U20Y2K76Ubw=="}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:32.563562 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-0f6c5b21-82f9-45e6-9f45-e847c735a59f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for project 61bf4a49abd8479f895e68d4954412b2. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:17:32.568381 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-0f6c5b21-82f9-45e6-9f45-e847c735a59f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for user 096d0da1a0bc401c95bfbb8fc150a27b and project 61bf4a49abd8479f895e68d4954412b2. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:17:32.594538 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0f6c5b21-82f9-45e6-9f45-e847c735a59f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056275 Aug 05 07:17:32.595150 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 175/362] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 5 07:17:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:32.890497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c7c53efb-ba5f-42dd-99ef-d53908868f2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:32.891239 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c7c53efb-ba5f-42dd-99ef-d53908868f2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:32.898675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c7c53efb-ba5f-42dd-99ef-d53908868f2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:32.899287 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c7c53efb-ba5f-42dd-99ef-d53908868f2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:32.899931 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c7c53efb-ba5f-42dd-99ef-d53908868f2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:32.900723 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c7c53efb-ba5f-42dd-99ef-d53908868f2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:32.901368 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c7c53efb-ba5f-42dd-99ef-d53908868f2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:32.901969 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c7c53efb-ba5f-42dd-99ef-d53908868f2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:33.090984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c7c53efb-ba5f-42dd-99ef-d53908868f2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:33.101339 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c7c53efb-ba5f-42dd-99ef-d53908868f2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1724 microversion: 2.1 time: 0.217982 Aug 05 07:17:33.101926 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 188/363] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:32 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:33.138804 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7f61c06d-56ef-4383-8d1c-8905985ecf61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:33.139515 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7f61c06d-56ef-4383-8d1c-8905985ecf61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:33.149473 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f61c06d-56ef-4383-8d1c-8905985ecf61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:33.149964 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f61c06d-56ef-4383-8d1c-8905985ecf61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:33.150402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f61c06d-56ef-4383-8d1c-8905985ecf61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:33.151096 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f61c06d-56ef-4383-8d1c-8905985ecf61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:33.151542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f61c06d-56ef-4383-8d1c-8905985ecf61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:33.151990 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f61c06d-56ef-4383-8d1c-8905985ecf61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:33.288804 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7f61c06d-56ef-4383-8d1c-8905985ecf61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:33.296869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7f61c06d-56ef-4383-8d1c-8905985ecf61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.162177 Aug 05 07:17:33.297469 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 176/364] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:33 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:33.934718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1885084581", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "470083bd-345d-480f-9634-dd509ffd0df2"}], "security_groups": [{"name": "tempest-securitygroup--3317658"}], "key_name": "tempest-keypair-1764988882", "user_data": "}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:34.055900 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] validate_networks() for [('470083bd-345d-480f-9634-dd509ffd0df2', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:17:34.122701 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8ea6197f-b6c6-4b27-b283-cf2f2c1fecdf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:34.123431 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8ea6197f-b6c6-4b27-b283-cf2f2c1fecdf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:34.125472 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:34.131138 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ea6197f-b6c6-4b27-b283-cf2f2c1fecdf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:34.131794 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ea6197f-b6c6-4b27-b283-cf2f2c1fecdf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:34.132218 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ea6197f-b6c6-4b27-b283-cf2f2c1fecdf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:34.132921 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ea6197f-b6c6-4b27-b283-cf2f2c1fecdf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:34.133384 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ea6197f-b6c6-4b27-b283-cf2f2c1fecdf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:34.133793 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ea6197f-b6c6-4b27-b283-cf2f2c1fecdf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:34.269165 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8ea6197f-b6c6-4b27-b283-cf2f2c1fecdf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:34.277805 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8ea6197f-b6c6-4b27-b283-cf2f2c1fecdf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1724 microversion: 2.1 time: 0.159350 Aug 05 07:17:34.278665 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 177/365] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:34 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:34.319111 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-131198da-2abc-4424-8a85-817a0304f1b0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:34.319741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-131198da-2abc-4424-8a85-817a0304f1b0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:34.326412 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-131198da-2abc-4424-8a85-817a0304f1b0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:34.326917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-131198da-2abc-4424-8a85-817a0304f1b0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:34.327346 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-131198da-2abc-4424-8a85-817a0304f1b0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:34.328117 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-131198da-2abc-4424-8a85-817a0304f1b0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:34.328569 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-131198da-2abc-4424-8a85-817a0304f1b0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:34.329020 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-131198da-2abc-4424-8a85-817a0304f1b0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:34.441798 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:17:34.442293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:17:34.442632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:17:34.443032 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:17:34.443502 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:17:34.453033 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:34.453504 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:34.453929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:34.454633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:34.455071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:34.455488 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:34.469895 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-131198da-2abc-4424-8a85-817a0304f1b0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:34.472369 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for project 61bf4a49abd8479f895e68d4954412b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:17:34.476353 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for user 096d0da1a0bc401c95bfbb8fc150a27b and project 61bf4a49abd8479f895e68d4954412b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:17:34.479406 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-131198da-2abc-4424-8a85-817a0304f1b0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.164496 Aug 05 07:17:34.479971 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 178/366] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:34 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:17:34.487325 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:17:34.489641 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:17:34.539159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-37f39729-cbcd-4893-aad1-51d0066de663 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.608810 Aug 05 07:17:34.539792 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 189/367] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:17:33 2022] POST /compute/v2.1/servers => generated 399 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:17:34.551330 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8367bb23-3a30-4811-ad63-0c721ac3e314 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:34.552044 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8367bb23-3a30-4811-ad63-0c721ac3e314 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:34.605715 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8367bb23-3a30-4811-ad63-0c721ac3e314 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:34.612816 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8367bb23-3a30-4811-ad63-0c721ac3e314 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1242 microversion: 2.1 time: 0.065462 Aug 05 07:17:34.613411 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 179/368] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:34 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:35.300127 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-36e448e0-c9bc-4a32-805a-e3af1c5b6c10 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:35.300739 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-36e448e0-c9bc-4a32-805a-e3af1c5b6c10 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:35.308071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-36e448e0-c9bc-4a32-805a-e3af1c5b6c10 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:35.308553 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-36e448e0-c9bc-4a32-805a-e3af1c5b6c10 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:35.309028 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-36e448e0-c9bc-4a32-805a-e3af1c5b6c10 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:35.309769 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-36e448e0-c9bc-4a32-805a-e3af1c5b6c10 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:35.310228 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-36e448e0-c9bc-4a32-805a-e3af1c5b6c10 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:35.310654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-36e448e0-c9bc-4a32-805a-e3af1c5b6c10 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:35.456323 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-36e448e0-c9bc-4a32-805a-e3af1c5b6c10 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:35.465923 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-36e448e0-c9bc-4a32-805a-e3af1c5b6c10 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1724 microversion: 2.1 time: 0.170266 Aug 05 07:17:35.466630 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 190/369] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:35 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:35.500684 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-380eaaeb-05b8-4a3b-ab92-cd8d7ce246af tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:35.501525 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-380eaaeb-05b8-4a3b-ab92-cd8d7ce246af tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:35.508155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-380eaaeb-05b8-4a3b-ab92-cd8d7ce246af tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:35.508638 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-380eaaeb-05b8-4a3b-ab92-cd8d7ce246af tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:35.509107 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-380eaaeb-05b8-4a3b-ab92-cd8d7ce246af tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:35.509806 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-380eaaeb-05b8-4a3b-ab92-cd8d7ce246af tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:35.510254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-380eaaeb-05b8-4a3b-ab92-cd8d7ce246af tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:35.510674 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-380eaaeb-05b8-4a3b-ab92-cd8d7ce246af tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:35.634049 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8fb19614-a72b-4cf1-819d-9e76d5f57845 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:35.634975 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8fb19614-a72b-4cf1-819d-9e76d5f57845 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:35.642329 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8fb19614-a72b-4cf1-819d-9e76d5f57845 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:35.643089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8fb19614-a72b-4cf1-819d-9e76d5f57845 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:35.643522 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8fb19614-a72b-4cf1-819d-9e76d5f57845 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:35.644288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8fb19614-a72b-4cf1-819d-9e76d5f57845 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:35.644743 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8fb19614-a72b-4cf1-819d-9e76d5f57845 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:35.645199 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8fb19614-a72b-4cf1-819d-9e76d5f57845 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:35.663440 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-380eaaeb-05b8-4a3b-ab92-cd8d7ce246af tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:35.671695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-380eaaeb-05b8-4a3b-ab92-cd8d7ce246af tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.175009 Aug 05 07:17:35.672396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 180/370] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:35 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:35.711515 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-8fb19614-a72b-4cf1-819d-9e76d5f57845 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:35.719269 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8fb19614-a72b-4cf1-819d-9e76d5f57845 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1302 microversion: 2.1 time: 0.089451 Aug 05 07:17:35.719843 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 191/371] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:35 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1302 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:36.487672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cf576949-83f4-4b10-bb90-41da15736986 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:36.488387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cf576949-83f4-4b10-bb90-41da15736986 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:36.494617 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cf576949-83f4-4b10-bb90-41da15736986 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:36.495099 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cf576949-83f4-4b10-bb90-41da15736986 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:36.495529 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cf576949-83f4-4b10-bb90-41da15736986 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:36.496222 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cf576949-83f4-4b10-bb90-41da15736986 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:36.496672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cf576949-83f4-4b10-bb90-41da15736986 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:36.497273 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cf576949-83f4-4b10-bb90-41da15736986 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:36.659288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cf576949-83f4-4b10-bb90-41da15736986 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:36.668420 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cf576949-83f4-4b10-bb90-41da15736986 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1701 microversion: 2.1 time: 0.184641 Aug 05 07:17:36.669089 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 181/372] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:36 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1701 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:36.692799 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7f0f2af3-a053-4444-8631-93455729f2f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:36.694856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-aff01b96-476f-42bf-bb88-8715fe2724ac tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:36.695475 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-aff01b96-476f-42bf-bb88-8715fe2724ac tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:36.705279 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aff01b96-476f-42bf-bb88-8715fe2724ac tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:36.705827 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aff01b96-476f-42bf-bb88-8715fe2724ac tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:36.706258 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aff01b96-476f-42bf-bb88-8715fe2724ac tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:36.706966 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aff01b96-476f-42bf-bb88-8715fe2724ac tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:36.707466 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aff01b96-476f-42bf-bb88-8715fe2724ac tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:36.707660 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f0f2af3-a053-4444-8631-93455729f2f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:36.707900 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aff01b96-476f-42bf-bb88-8715fe2724ac tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:36.708372 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f0f2af3-a053-4444-8631-93455729f2f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:36.709059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f0f2af3-a053-4444-8631-93455729f2f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:36.772816 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7f0f2af3-a053-4444-8631-93455729f2f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Going to try to start instance {{(pid=117894) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 07:17:36.829497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7f0f2af3-a053-4444-8631-93455729f2f9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "POST /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/action" status: 202 len: 0 microversion: 2.1 time: 0.142998 Aug 05 07:17:36.830874 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 192/373] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:17:36 2022] POST /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 07:17:36.838930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0c4b4c19-e6b8-47df-be1c-6291ac05dc76 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:36.840183 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0c4b4c19-e6b8-47df-be1c-6291ac05dc76 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:36.856843 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c4b4c19-e6b8-47df-be1c-6291ac05dc76 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:36.857582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c4b4c19-e6b8-47df-be1c-6291ac05dc76 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:36.858028 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c4b4c19-e6b8-47df-be1c-6291ac05dc76 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:36.858814 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c4b4c19-e6b8-47df-be1c-6291ac05dc76 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:36.859268 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c4b4c19-e6b8-47df-be1c-6291ac05dc76 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:36.859870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c4b4c19-e6b8-47df-be1c-6291ac05dc76 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:36.893793 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:36.897526 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aff01b96-476f-42bf-bb88-8715fe2724ac tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:36.907254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-aff01b96-476f-42bf-bb88-8715fe2724ac tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.216829 Aug 05 07:17:36.907968 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 182/374] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:36 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:36.913954 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5db06762-e1e3-40a2-a3ad-af4ee543b662 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:36.914565 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5db06762-e1e3-40a2-a3ad-af4ee543b662 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:36.920799 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5db06762-e1e3-40a2-a3ad-af4ee543b662 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:36.921506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5db06762-e1e3-40a2-a3ad-af4ee543b662 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:36.922136 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5db06762-e1e3-40a2-a3ad-af4ee543b662 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:36.922837 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5db06762-e1e3-40a2-a3ad-af4ee543b662 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:36.923446 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5db06762-e1e3-40a2-a3ad-af4ee543b662 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:36.924026 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5db06762-e1e3-40a2-a3ad-af4ee543b662 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:37.071444 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5db06762-e1e3-40a2-a3ad-af4ee543b662 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:37.075037 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:37.081278 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5db06762-e1e3-40a2-a3ad-af4ee543b662 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1710 microversion: 2.1 time: 0.172045 Aug 05 07:17:37.082005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 183/375] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:36 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1710 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:37.238444 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0c4b4c19-e6b8-47df-be1c-6291ac05dc76 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:37.246677 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0c4b4c19-e6b8-47df-be1c-6291ac05dc76 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1365 microversion: 2.1 time: 0.414353 Aug 05 07:17:37.247335 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 193/376] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:36 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1365 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:37.798601 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-6b4c21f0-c950-4551-b991-50fa5f4ff35d req-58ac950f-e4ea-406f-8d58-190ba19bba65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbeb5f6-8ae7-4d07-b089-62cc142fddb1", "tag": "b91dfe51-18b8-4867-aa8f-b69a34991b20"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:37.811201 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-6b4c21f0-c950-4551-b991-50fa5f4ff35d req-58ac950f-e4ea-406f-8d58-190ba19bba65 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:37.811669 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-6b4c21f0-c950-4551-b991-50fa5f4ff35d req-58ac950f-e4ea-406f-8d58-190ba19bba65 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:37.812092 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-6b4c21f0-c950-4551-b991-50fa5f4ff35d req-58ac950f-e4ea-406f-8d58-190ba19bba65 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:37.826000 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-6b4c21f0-c950-4551-b991-50fa5f4ff35d req-58ac950f-e4ea-406f-8d58-190ba19bba65 service nova] Creating event network-changed:b91dfe51-18b8-4867-aa8f-b69a34991b20 for instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 on hv-cinder-85200 Aug 05 07:17:37.830798 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-6b4c21f0-c950-4551-b991-50fa5f4ff35d req-58ac950f-e4ea-406f-8d58-190ba19bba65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036767 Aug 05 07:17:37.831384 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 184/377] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:37.927969 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e98e3f98-4848-459e-bf8b-e73a0d88b1d0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:37.928566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e98e3f98-4848-459e-bf8b-e73a0d88b1d0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:37.935932 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e98e3f98-4848-459e-bf8b-e73a0d88b1d0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:37.936395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e98e3f98-4848-459e-bf8b-e73a0d88b1d0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:37.936821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e98e3f98-4848-459e-bf8b-e73a0d88b1d0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:37.937571 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e98e3f98-4848-459e-bf8b-e73a0d88b1d0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:37.938020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e98e3f98-4848-459e-bf8b-e73a0d88b1d0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:37.938433 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e98e3f98-4848-459e-bf8b-e73a0d88b1d0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:38.068978 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e98e3f98-4848-459e-bf8b-e73a0d88b1d0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:38.076720 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e98e3f98-4848-459e-bf8b-e73a0d88b1d0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.152586 Aug 05 07:17:38.077313 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 194/378] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:37 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:38.106976 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3e207061-a6f4-4df7-95e4-57e9bf5a4922 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:38.108153 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3e207061-a6f4-4df7-95e4-57e9bf5a4922 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:38.117751 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e207061-a6f4-4df7-95e4-57e9bf5a4922 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:38.118522 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e207061-a6f4-4df7-95e4-57e9bf5a4922 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:38.119194 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e207061-a6f4-4df7-95e4-57e9bf5a4922 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:38.120274 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e207061-a6f4-4df7-95e4-57e9bf5a4922 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:38.121054 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e207061-a6f4-4df7-95e4-57e9bf5a4922 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:38.121728 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3e207061-a6f4-4df7-95e4-57e9bf5a4922 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:38.266605 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3e207061-a6f4-4df7-95e4-57e9bf5a4922 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:38.267842 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-de4a7956-7455-4ebf-9eb0-467fd24e91c6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:38.268459 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-de4a7956-7455-4ebf-9eb0-467fd24e91c6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:38.275009 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de4a7956-7455-4ebf-9eb0-467fd24e91c6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:38.275494 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de4a7956-7455-4ebf-9eb0-467fd24e91c6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:38.275731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3e207061-a6f4-4df7-95e4-57e9bf5a4922 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1710 microversion: 2.1 time: 0.175770 Aug 05 07:17:38.275929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de4a7956-7455-4ebf-9eb0-467fd24e91c6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:38.276616 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de4a7956-7455-4ebf-9eb0-467fd24e91c6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:38.277265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 185/379] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:38 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:38.277759 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de4a7956-7455-4ebf-9eb0-467fd24e91c6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:38.278403 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de4a7956-7455-4ebf-9eb0-467fd24e91c6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:38.516032 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-de4a7956-7455-4ebf-9eb0-467fd24e91c6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:38.524473 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-de4a7956-7455-4ebf-9eb0-467fd24e91c6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1365 microversion: 2.1 time: 0.260354 Aug 05 07:17:38.524965 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 195/380] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:38 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:17:39.101645 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c5fd8f7d-05f7-40a0-a18e-952ea9b43a91 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:39.102580 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c5fd8f7d-05f7-40a0-a18e-952ea9b43a91 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:39.111040 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5fd8f7d-05f7-40a0-a18e-952ea9b43a91 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:39.111523 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5fd8f7d-05f7-40a0-a18e-952ea9b43a91 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:39.111951 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5fd8f7d-05f7-40a0-a18e-952ea9b43a91 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:39.112643 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5fd8f7d-05f7-40a0-a18e-952ea9b43a91 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:39.113143 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5fd8f7d-05f7-40a0-a18e-952ea9b43a91 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:39.113558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5fd8f7d-05f7-40a0-a18e-952ea9b43a91 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:39.280412 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c5fd8f7d-05f7-40a0-a18e-952ea9b43a91 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:39.292626 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c5fd8f7d-05f7-40a0-a18e-952ea9b43a91 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.197638 Aug 05 07:17:39.293266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 186/381] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:39 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:39.298648 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-46bc47d4-293a-47d4-93ba-17a41f34328d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:39.299363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-46bc47d4-293a-47d4-93ba-17a41f34328d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:39.306938 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46bc47d4-293a-47d4-93ba-17a41f34328d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:39.307415 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46bc47d4-293a-47d4-93ba-17a41f34328d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:39.307845 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46bc47d4-293a-47d4-93ba-17a41f34328d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:39.308572 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46bc47d4-293a-47d4-93ba-17a41f34328d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:39.309053 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46bc47d4-293a-47d4-93ba-17a41f34328d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:39.309534 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46bc47d4-293a-47d4-93ba-17a41f34328d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:39.546940 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e658efab-c549-4b65-b192-3ef437170dc8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:39.547592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e658efab-c549-4b65-b192-3ef437170dc8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:39.554339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e658efab-c549-4b65-b192-3ef437170dc8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:39.554831 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e658efab-c549-4b65-b192-3ef437170dc8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:39.555387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e658efab-c549-4b65-b192-3ef437170dc8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:39.556135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e658efab-c549-4b65-b192-3ef437170dc8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:39.556553 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e658efab-c549-4b65-b192-3ef437170dc8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:39.557005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e658efab-c549-4b65-b192-3ef437170dc8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:39.682944 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-46bc47d4-293a-47d4-93ba-17a41f34328d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:39.691141 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-46bc47d4-293a-47d4-93ba-17a41f34328d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1714 microversion: 2.1 time: 0.397223 Aug 05 07:17:39.691724 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 196/382] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:39 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1714 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:39.693359 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e658efab-c549-4b65-b192-3ef437170dc8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:39.701070 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e658efab-c549-4b65-b192-3ef437170dc8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1365 microversion: 2.1 time: 0.158210 Aug 05 07:17:39.701706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 187/383] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:39 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:40.316620 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7d7bfdda-fcec-4477-a74c-7cabb9b6058c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:40.317435 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7d7bfdda-fcec-4477-a74c-7cabb9b6058c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:40.327494 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d7bfdda-fcec-4477-a74c-7cabb9b6058c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:40.328173 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d7bfdda-fcec-4477-a74c-7cabb9b6058c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:40.328770 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d7bfdda-fcec-4477-a74c-7cabb9b6058c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:40.329690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d7bfdda-fcec-4477-a74c-7cabb9b6058c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:40.330377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d7bfdda-fcec-4477-a74c-7cabb9b6058c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:40.330841 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d7bfdda-fcec-4477-a74c-7cabb9b6058c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:40.472722 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7d7bfdda-fcec-4477-a74c-7cabb9b6058c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:40.487466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7d7bfdda-fcec-4477-a74c-7cabb9b6058c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.175611 Aug 05 07:17:40.488331 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 197/384] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:40 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:40.729338 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-97981bbe-dfd6-475b-b610-0b70b3e907fb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:40.730157 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-97981bbe-dfd6-475b-b610-0b70b3e907fb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:40.737849 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97981bbe-dfd6-475b-b610-0b70b3e907fb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:40.738295 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97981bbe-dfd6-475b-b610-0b70b3e907fb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:40.738731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97981bbe-dfd6-475b-b610-0b70b3e907fb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:40.739435 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97981bbe-dfd6-475b-b610-0b70b3e907fb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:40.739968 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97981bbe-dfd6-475b-b610-0b70b3e907fb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:40.740545 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97981bbe-dfd6-475b-b610-0b70b3e907fb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:40.881695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-97981bbe-dfd6-475b-b610-0b70b3e907fb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:40.890569 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-97981bbe-dfd6-475b-b610-0b70b3e907fb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1365 microversion: 2.1 time: 0.167687 Aug 05 07:17:40.891166 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 188/385] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:40 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:41.514377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f3cc014c-6a9e-4708-b28a-32dd6d780f6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:41.515083 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f3cc014c-6a9e-4708-b28a-32dd6d780f6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:41.522229 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f3cc014c-6a9e-4708-b28a-32dd6d780f6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:41.522711 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f3cc014c-6a9e-4708-b28a-32dd6d780f6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:41.523509 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f3cc014c-6a9e-4708-b28a-32dd6d780f6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:41.524202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f3cc014c-6a9e-4708-b28a-32dd6d780f6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:41.524657 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f3cc014c-6a9e-4708-b28a-32dd6d780f6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:41.525118 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f3cc014c-6a9e-4708-b28a-32dd6d780f6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:41.678143 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f3cc014c-6a9e-4708-b28a-32dd6d780f6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:41.686265 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f3cc014c-6a9e-4708-b28a-32dd6d780f6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.177063 Aug 05 07:17:41.686828 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 198/386] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:41 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:41.912178 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a2e7a5ff-02a4-476b-9660-4f37e3c13eb1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:41.912885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a2e7a5ff-02a4-476b-9660-4f37e3c13eb1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:41.915193 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:41.920923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2e7a5ff-02a4-476b-9660-4f37e3c13eb1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:41.921411 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2e7a5ff-02a4-476b-9660-4f37e3c13eb1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:41.921892 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2e7a5ff-02a4-476b-9660-4f37e3c13eb1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:41.922533 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2e7a5ff-02a4-476b-9660-4f37e3c13eb1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:41.922986 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2e7a5ff-02a4-476b-9660-4f37e3c13eb1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:41.923410 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2e7a5ff-02a4-476b-9660-4f37e3c13eb1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:42.061672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a2e7a5ff-02a4-476b-9660-4f37e3c13eb1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:42.069277 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a2e7a5ff-02a4-476b-9660-4f37e3c13eb1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1365 microversion: 2.1 time: 0.161229 Aug 05 07:17:42.069846 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 189/387] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:41 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:42.711613 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-fe667d4a-16e2-4b55-95f9-449e3389c114 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:42.712451 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-fe667d4a-16e2-4b55-95f9-449e3389c114 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:42.720700 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fe667d4a-16e2-4b55-95f9-449e3389c114 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:42.721250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fe667d4a-16e2-4b55-95f9-449e3389c114 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:42.721675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fe667d4a-16e2-4b55-95f9-449e3389c114 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:42.722355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fe667d4a-16e2-4b55-95f9-449e3389c114 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:42.722824 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fe667d4a-16e2-4b55-95f9-449e3389c114 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:42.723238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fe667d4a-16e2-4b55-95f9-449e3389c114 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:42.856792 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-fe667d4a-16e2-4b55-95f9-449e3389c114 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:42.864579 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-fe667d4a-16e2-4b55-95f9-449e3389c114 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.159655 Aug 05 07:17:42.865232 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 199/388] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:42 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:43.090601 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f9964138-e927-4f5e-a5ea-52032b6dd273 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:43.091296 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f9964138-e927-4f5e-a5ea-52032b6dd273 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:43.098559 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9964138-e927-4f5e-a5ea-52032b6dd273 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:43.099037 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9964138-e927-4f5e-a5ea-52032b6dd273 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:43.099471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9964138-e927-4f5e-a5ea-52032b6dd273 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:43.100145 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9964138-e927-4f5e-a5ea-52032b6dd273 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:43.100584 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9964138-e927-4f5e-a5ea-52032b6dd273 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:43.101157 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9964138-e927-4f5e-a5ea-52032b6dd273 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:43.239845 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f9964138-e927-4f5e-a5ea-52032b6dd273 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:43.247830 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f9964138-e927-4f5e-a5ea-52032b6dd273 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1365 microversion: 2.1 time: 0.161179 Aug 05 07:17:43.248371 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 190/389] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:43 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:43.885726 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-976d119c-3b2f-43a5-85b8-7c4cffb9acd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:43.886309 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-976d119c-3b2f-43a5-85b8-7c4cffb9acd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:43.893210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-976d119c-3b2f-43a5-85b8-7c4cffb9acd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:43.893690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-976d119c-3b2f-43a5-85b8-7c4cffb9acd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:43.894129 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-976d119c-3b2f-43a5-85b8-7c4cffb9acd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:43.894825 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-976d119c-3b2f-43a5-85b8-7c4cffb9acd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:43.895275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-976d119c-3b2f-43a5-85b8-7c4cffb9acd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:43.895697 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-976d119c-3b2f-43a5-85b8-7c4cffb9acd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:44.031668 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-976d119c-3b2f-43a5-85b8-7c4cffb9acd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:44.039637 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-976d119c-3b2f-43a5-85b8-7c4cffb9acd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.157801 Aug 05 07:17:44.040213 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 200/390] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:43 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:44.271374 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6691079d-5a2d-4bba-9a26-36f050365bda tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:44.271983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6691079d-5a2d-4bba-9a26-36f050365bda tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:44.279203 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6691079d-5a2d-4bba-9a26-36f050365bda tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:44.279809 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6691079d-5a2d-4bba-9a26-36f050365bda tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:44.280259 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6691079d-5a2d-4bba-9a26-36f050365bda tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:44.280969 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6691079d-5a2d-4bba-9a26-36f050365bda tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:44.281425 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6691079d-5a2d-4bba-9a26-36f050365bda tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:44.281844 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6691079d-5a2d-4bba-9a26-36f050365bda tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:44.436203 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6691079d-5a2d-4bba-9a26-36f050365bda tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:44.448677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6691079d-5a2d-4bba-9a26-36f050365bda tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1365 microversion: 2.1 time: 0.180999 Aug 05 07:17:44.449584 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 191/391] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:44 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:45.063103 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-bd7b89e1-ab53-4472-89bd-dc59b219ee33 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:45.063948 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-bd7b89e1-ab53-4472-89bd-dc59b219ee33 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:45.066679 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:45.067663 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=8 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:45.078094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bd7b89e1-ab53-4472-89bd-dc59b219ee33 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:45.078094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bd7b89e1-ab53-4472-89bd-dc59b219ee33 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:45.078436 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bd7b89e1-ab53-4472-89bd-dc59b219ee33 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:45.079232 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bd7b89e1-ab53-4472-89bd-dc59b219ee33 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:45.079759 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bd7b89e1-ab53-4472-89bd-dc59b219ee33 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:45.080238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bd7b89e1-ab53-4472-89bd-dc59b219ee33 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:45.220802 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-bd7b89e1-ab53-4472-89bd-dc59b219ee33 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:45.228393 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-bd7b89e1-ab53-4472-89bd-dc59b219ee33 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.171464 Aug 05 07:17:45.228953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 201/392] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:45 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:45.471233 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3dc07aef-20b3-4f06-a7e5-9bae4c586431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:45.471792 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3dc07aef-20b3-4f06-a7e5-9bae4c586431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:45.473739 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=12 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:45.479729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3dc07aef-20b3-4f06-a7e5-9bae4c586431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:45.480348 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3dc07aef-20b3-4f06-a7e5-9bae4c586431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:45.480793 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3dc07aef-20b3-4f06-a7e5-9bae4c586431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:45.481505 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3dc07aef-20b3-4f06-a7e5-9bae4c586431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:45.481934 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3dc07aef-20b3-4f06-a7e5-9bae4c586431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:45.482342 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3dc07aef-20b3-4f06-a7e5-9bae4c586431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:45.619635 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3dc07aef-20b3-4f06-a7e5-9bae4c586431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:45.627448 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3dc07aef-20b3-4f06-a7e5-9bae4c586431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1365 microversion: 2.1 time: 0.160472 Aug 05 07:17:45.628016 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 192/393] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:45 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:45.671331 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-9945fb83-8f7a-46e8-88d1-0c5565ec044f req-2610f314-4b11-4272-9540-c6ac035b9444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbeb5f6-8ae7-4d07-b089-62cc142fddb1", "name": "network-vif-plugged", "status": "completed", "tag": "b91dfe51-18b8-4867-aa8f-b69a34991b20"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:45.680951 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9945fb83-8f7a-46e8-88d1-0c5565ec044f req-2610f314-4b11-4272-9540-c6ac035b9444 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:45.681442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9945fb83-8f7a-46e8-88d1-0c5565ec044f req-2610f314-4b11-4272-9540-c6ac035b9444 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:45.681864 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9945fb83-8f7a-46e8-88d1-0c5565ec044f req-2610f314-4b11-4272-9540-c6ac035b9444 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:45.694290 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-9945fb83-8f7a-46e8-88d1-0c5565ec044f req-2610f314-4b11-4272-9540-c6ac035b9444 service nova] Creating event network-vif-plugged:b91dfe51-18b8-4867-aa8f-b69a34991b20 for instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 on hv-cinder-85200 Aug 05 07:17:45.699084 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-9945fb83-8f7a-46e8-88d1-0c5565ec044f req-2610f314-4b11-4272-9540-c6ac035b9444 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031458 Aug 05 07:17:45.699693 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 202/394] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:46.249252 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3bee307c-23c6-44d9-b61c-d91b38501719 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:46.249858 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3bee307c-23c6-44d9-b61c-d91b38501719 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:46.256438 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bee307c-23c6-44d9-b61c-d91b38501719 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:46.256927 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bee307c-23c6-44d9-b61c-d91b38501719 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:46.257381 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bee307c-23c6-44d9-b61c-d91b38501719 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:46.258083 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bee307c-23c6-44d9-b61c-d91b38501719 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:46.258552 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bee307c-23c6-44d9-b61c-d91b38501719 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:46.258978 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bee307c-23c6-44d9-b61c-d91b38501719 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:46.397086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3bee307c-23c6-44d9-b61c-d91b38501719 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:46.405398 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3bee307c-23c6-44d9-b61c-d91b38501719 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.160229 Aug 05 07:17:46.405959 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 193/395] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:46 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:46.650068 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8376362b-af45-4aa0-8cb5-9de865678bdf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:46.650635 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8376362b-af45-4aa0-8cb5-9de865678bdf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:46.657580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8376362b-af45-4aa0-8cb5-9de865678bdf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:46.658058 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8376362b-af45-4aa0-8cb5-9de865678bdf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:46.658487 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8376362b-af45-4aa0-8cb5-9de865678bdf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:46.659138 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8376362b-af45-4aa0-8cb5-9de865678bdf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:46.659610 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8376362b-af45-4aa0-8cb5-9de865678bdf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:46.660023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8376362b-af45-4aa0-8cb5-9de865678bdf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:46.805038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-8376362b-af45-4aa0-8cb5-9de865678bdf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:46.816716 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8376362b-af45-4aa0-8cb5-9de865678bdf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1365 microversion: 2.1 time: 0.171820 Aug 05 07:17:46.817541 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 203/396] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:46 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:47.426873 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d5cc54d7-9af8-4cd0-b850-0531deb3eae1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:47.427545 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d5cc54d7-9af8-4cd0-b850-0531deb3eae1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:47.436081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d5cc54d7-9af8-4cd0-b850-0531deb3eae1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:47.436584 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d5cc54d7-9af8-4cd0-b850-0531deb3eae1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:47.437051 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d5cc54d7-9af8-4cd0-b850-0531deb3eae1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:47.437789 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d5cc54d7-9af8-4cd0-b850-0531deb3eae1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:47.438215 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d5cc54d7-9af8-4cd0-b850-0531deb3eae1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:47.438654 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d5cc54d7-9af8-4cd0-b850-0531deb3eae1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:47.573945 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d5cc54d7-9af8-4cd0-b850-0531deb3eae1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:47.582134 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d5cc54d7-9af8-4cd0-b850-0531deb3eae1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.159473 Aug 05 07:17:47.582712 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 194/397] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:47 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:47.724161 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-9c259602-b7da-4e94-ad4e-854aba71668b req-fe77674b-4734-40cf-84b4-361f1f445955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f14ba1-bb82-4edf-baf2-308048c6c67c", "name": "network-vif-plugged", "status": "completed", "tag": "7df94f6e-8c50-4ecc-aa16-ac32883658a4"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:47.729482 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:47.735409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9c259602-b7da-4e94-ad4e-854aba71668b req-fe77674b-4734-40cf-84b4-361f1f445955 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:47.735878 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9c259602-b7da-4e94-ad4e-854aba71668b req-fe77674b-4734-40cf-84b4-361f1f445955 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:47.736303 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9c259602-b7da-4e94-ad4e-854aba71668b req-fe77674b-4734-40cf-84b4-361f1f445955 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:47.751958 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-9c259602-b7da-4e94-ad4e-854aba71668b req-fe77674b-4734-40cf-84b4-361f1f445955 service nova] Creating event network-vif-plugged:7df94f6e-8c50-4ecc-aa16-ac32883658a4 for instance b8f14ba1-bb82-4edf-baf2-308048c6c67c on hv-cinder-85200 Aug 05 07:17:47.756828 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-9c259602-b7da-4e94-ad4e-854aba71668b req-fe77674b-4734-40cf-84b4-361f1f445955 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036683 Aug 05 07:17:47.757451 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 204/398] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:47.841906 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1d7c9690-7ac0-477b-8930-6b1e5afd2e52 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:47.842892 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1d7c9690-7ac0-477b-8930-6b1e5afd2e52 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:47.849558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d7c9690-7ac0-477b-8930-6b1e5afd2e52 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:47.850041 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d7c9690-7ac0-477b-8930-6b1e5afd2e52 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:47.850476 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d7c9690-7ac0-477b-8930-6b1e5afd2e52 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:47.851167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d7c9690-7ac0-477b-8930-6b1e5afd2e52 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:47.851614 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d7c9690-7ac0-477b-8930-6b1e5afd2e52 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:47.852037 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d7c9690-7ac0-477b-8930-6b1e5afd2e52 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:47.986948 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1d7c9690-7ac0-477b-8930-6b1e5afd2e52 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:47.997923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1d7c9690-7ac0-477b-8930-6b1e5afd2e52 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1365 microversion: 2.1 time: 0.162374 Aug 05 07:17:47.998739 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 195/399] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:47 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:48.604555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-cdbde3a6-82f9-4324-baef-63c38e86897c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:48.605284 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-cdbde3a6-82f9-4324-baef-63c38e86897c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:48.611731 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cdbde3a6-82f9-4324-baef-63c38e86897c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:48.612210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cdbde3a6-82f9-4324-baef-63c38e86897c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:48.612657 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cdbde3a6-82f9-4324-baef-63c38e86897c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:48.613387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cdbde3a6-82f9-4324-baef-63c38e86897c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:48.613839 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cdbde3a6-82f9-4324-baef-63c38e86897c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:48.614281 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cdbde3a6-82f9-4324-baef-63c38e86897c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:48.749656 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cdbde3a6-82f9-4324-baef-63c38e86897c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:48.757664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-cdbde3a6-82f9-4324-baef-63c38e86897c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.158281 Aug 05 07:17:48.758228 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 205/400] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:48 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:49.019826 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-edfe7906-91b9-4867-904c-91182d31ea54 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:49.020430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-edfe7906-91b9-4867-904c-91182d31ea54 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:49.027437 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-edfe7906-91b9-4867-904c-91182d31ea54 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:49.027924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-edfe7906-91b9-4867-904c-91182d31ea54 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:49.028328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-edfe7906-91b9-4867-904c-91182d31ea54 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:49.029046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-edfe7906-91b9-4867-904c-91182d31ea54 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:49.029492 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-edfe7906-91b9-4867-904c-91182d31ea54 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:49.029902 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-edfe7906-91b9-4867-904c-91182d31ea54 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:49.181754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-edfe7906-91b9-4867-904c-91182d31ea54 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:49.190719 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-edfe7906-91b9-4867-904c-91182d31ea54 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1555 microversion: 2.1 time: 0.174848 Aug 05 07:17:49.191295 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 196/401] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:49 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:49.211079 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9e71ca76-dd47-4c98-ba5b-0f09fa0b28fd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:49.211566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9e71ca76-dd47-4c98-ba5b-0f09fa0b28fd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:49.217712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9e71ca76-dd47-4c98-ba5b-0f09fa0b28fd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:49.218294 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9e71ca76-dd47-4c98-ba5b-0f09fa0b28fd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:49.218751 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9e71ca76-dd47-4c98-ba5b-0f09fa0b28fd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:49.219443 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9e71ca76-dd47-4c98-ba5b-0f09fa0b28fd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:49.219901 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9e71ca76-dd47-4c98-ba5b-0f09fa0b28fd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:49.220328 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9e71ca76-dd47-4c98-ba5b-0f09fa0b28fd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:49.303262 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9e71ca76-dd47-4c98-ba5b-0f09fa0b28fd tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096089 Aug 05 07:17:49.303837 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 206/402] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 5 07:17:49 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:49.778927 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-12a2f2ec-c0d7-4521-80f6-5d76e1b37a78 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:49.779529 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-12a2f2ec-c0d7-4521-80f6-5d76e1b37a78 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:49.786400 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12a2f2ec-c0d7-4521-80f6-5d76e1b37a78 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:49.786834 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12a2f2ec-c0d7-4521-80f6-5d76e1b37a78 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:49.787274 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12a2f2ec-c0d7-4521-80f6-5d76e1b37a78 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:49.787986 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12a2f2ec-c0d7-4521-80f6-5d76e1b37a78 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:49.788417 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12a2f2ec-c0d7-4521-80f6-5d76e1b37a78 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:49.788940 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12a2f2ec-c0d7-4521-80f6-5d76e1b37a78 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:49.924282 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-12a2f2ec-c0d7-4521-80f6-5d76e1b37a78 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:49.932302 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-12a2f2ec-c0d7-4521-80f6-5d76e1b37a78 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1264 microversion: 2.1 time: 0.157276 Aug 05 07:17:49.932907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 197/403] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:49 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:50.254372 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-bd56bcfe-51b0-4d25-a0ee-34fc975b494b req-8fa5a9a7-9861-4708-b559-fb6ca768e4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbeb5f6-8ae7-4d07-b089-62cc142fddb1", "tag": "b91dfe51-18b8-4867-aa8f-b69a34991b20"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:50.263842 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-bd56bcfe-51b0-4d25-a0ee-34fc975b494b req-8fa5a9a7-9861-4708-b559-fb6ca768e4ff service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:50.264315 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-bd56bcfe-51b0-4d25-a0ee-34fc975b494b req-8fa5a9a7-9861-4708-b559-fb6ca768e4ff service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:50.264742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-bd56bcfe-51b0-4d25-a0ee-34fc975b494b req-8fa5a9a7-9861-4708-b559-fb6ca768e4ff service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:50.278136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-bd56bcfe-51b0-4d25-a0ee-34fc975b494b req-8fa5a9a7-9861-4708-b559-fb6ca768e4ff service nova] Creating event network-changed:b91dfe51-18b8-4867-aa8f-b69a34991b20 for instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 on hv-cinder-85200 Aug 05 07:17:50.285050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-bd56bcfe-51b0-4d25-a0ee-34fc975b494b req-8fa5a9a7-9861-4708-b559-fb6ca768e4ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034519 Aug 05 07:17:50.286087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 207/404] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:50.953746 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a40ef455-c6a1-44e0-be6b-ca51b4ca79e3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:50.954563 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a40ef455-c6a1-44e0-be6b-ca51b4ca79e3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:50.961672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a40ef455-c6a1-44e0-be6b-ca51b4ca79e3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:50.962442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a40ef455-c6a1-44e0-be6b-ca51b4ca79e3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:50.962879 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a40ef455-c6a1-44e0-be6b-ca51b4ca79e3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:50.963828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a40ef455-c6a1-44e0-be6b-ca51b4ca79e3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:50.964186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a40ef455-c6a1-44e0-be6b-ca51b4ca79e3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:50.964642 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a40ef455-c6a1-44e0-be6b-ca51b4ca79e3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:51.125232 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a40ef455-c6a1-44e0-be6b-ca51b4ca79e3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:51.139562 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a40ef455-c6a1-44e0-be6b-ca51b4ca79e3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1450 microversion: 2.1 time: 0.189703 Aug 05 07:17:51.140415 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 198/405] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:50 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1450 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:17:51.167369 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-85a67782-1aff-43d6-9cb8-a308fae99928 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:51.168257 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-85a67782-1aff-43d6-9cb8-a308fae99928 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:51.175389 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-85a67782-1aff-43d6-9cb8-a308fae99928 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:51.176148 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-85a67782-1aff-43d6-9cb8-a308fae99928 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:51.176508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-85a67782-1aff-43d6-9cb8-a308fae99928 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:51.177259 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-85a67782-1aff-43d6-9cb8-a308fae99928 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:51.177744 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-85a67782-1aff-43d6-9cb8-a308fae99928 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:51.178384 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-85a67782-1aff-43d6-9cb8-a308fae99928 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:51.391711 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-85a67782-1aff-43d6-9cb8-a308fae99928 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:17:51.400369 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-85a67782-1aff-43d6-9cb8-a308fae99928 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1450 microversion: 2.1 time: 0.237814 Aug 05 07:17:51.401416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 208/406] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:17:51 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1450 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:17:53.179413 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-99eb94dd-6af3-4e60-a964-fdac4e8e5d4f req-56ba6443-7434-4acc-85e7-3f82a8997118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8f14ba1-bb82-4edf-baf2-308048c6c67c", "tag": "7df94f6e-8c50-4ecc-aa16-ac32883658a4"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:17:53.190972 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-99eb94dd-6af3-4e60-a964-fdac4e8e5d4f req-56ba6443-7434-4acc-85e7-3f82a8997118 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:53.191453 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-99eb94dd-6af3-4e60-a964-fdac4e8e5d4f req-56ba6443-7434-4acc-85e7-3f82a8997118 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:53.191881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-99eb94dd-6af3-4e60-a964-fdac4e8e5d4f req-56ba6443-7434-4acc-85e7-3f82a8997118 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:53.205264 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-99eb94dd-6af3-4e60-a964-fdac4e8e5d4f req-56ba6443-7434-4acc-85e7-3f82a8997118 service nova] Creating event network-changed:7df94f6e-8c50-4ecc-aa16-ac32883658a4 for instance b8f14ba1-bb82-4edf-baf2-308048c6c67c on hv-cinder-85200 Aug 05 07:17:53.210741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-99eb94dd-6af3-4e60-a964-fdac4e8e5d4f req-56ba6443-7434-4acc-85e7-3f82a8997118 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036751 Aug 05 07:17:53.211344 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 199/407] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:17:59.444353 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-13df0970-0a28-438c-98de-6717c6b43d32 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:17:59.444937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-13df0970-0a28-438c-98de-6717c6b43d32 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:17:59.451697 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13df0970-0a28-438c-98de-6717c6b43d32 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:59.452186 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13df0970-0a28-438c-98de-6717c6b43d32 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:59.452627 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13df0970-0a28-438c-98de-6717c6b43d32 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:59.453361 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13df0970-0a28-438c-98de-6717c6b43d32 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:17:59.453804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13df0970-0a28-438c-98de-6717c6b43d32 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:17:59.454231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-13df0970-0a28-438c-98de-6717c6b43d32 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:17:59.478794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-13df0970-0a28-438c-98de-6717c6b43d32 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/ips" status: 200 len: 152 microversion: 2.20 time: 0.038471 Aug 05 07:17:59.479407 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 209/408] 10.222.0.27 () {60 vars in 1289 bytes} [Fri Aug 5 07:17:59 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:18:01.749364 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4506cd71-d4c4-4190-a116-619efdee2dad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:18:01.749995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4506cd71-d4c4-4190-a116-619efdee2dad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:01.757188 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4506cd71-d4c4-4190-a116-619efdee2dad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:01.757663 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4506cd71-d4c4-4190-a116-619efdee2dad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:01.758155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4506cd71-d4c4-4190-a116-619efdee2dad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:01.758821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4506cd71-d4c4-4190-a116-619efdee2dad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:01.759270 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4506cd71-d4c4-4190-a116-619efdee2dad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:01.759686 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4506cd71-d4c4-4190-a116-619efdee2dad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:01.784058 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-4506cd71-d4c4-4190-a116-619efdee2dad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lazy-loading 'flavor' on Instance uuid f664511a-28db-4ff6-90e9-7e2db58e94e2 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:18:01.827042 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:01.992085 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4506cd71-d4c4-4190-a116-619efdee2dad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "POST /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/action" status: 202 len: 0 microversion: 2.20 time: 0.247624 Aug 05 07:18:01.992692 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 200/409] 10.222.0.27 () {62 vars in 1319 bytes} [Fri Aug 5 07:18:01 2022] POST /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:18:02.001491 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-867bd798-6eb6-4c07-9d5f-18373a2c2c99 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:02.002090 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-867bd798-6eb6-4c07-9d5f-18373a2c2c99 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:02.009647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-867bd798-6eb6-4c07-9d5f-18373a2c2c99 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:02.010300 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-867bd798-6eb6-4c07-9d5f-18373a2c2c99 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:02.010810 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-867bd798-6eb6-4c07-9d5f-18373a2c2c99 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:02.011622 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-867bd798-6eb6-4c07-9d5f-18373a2c2c99 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:02.012086 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-867bd798-6eb6-4c07-9d5f-18373a2c2c99 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:02.012511 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-867bd798-6eb6-4c07-9d5f-18373a2c2c99 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:02.156041 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-867bd798-6eb6-4c07-9d5f-18373a2c2c99 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:02.164478 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-867bd798-6eb6-4c07-9d5f-18373a2c2c99 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:02.166007 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-867bd798-6eb6-4c07-9d5f-18373a2c2c99 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:02.167182 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-867bd798-6eb6-4c07-9d5f-18373a2c2c99 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.170053 Aug 05 07:18:02.167747 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 210/410] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:01 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:03.191122 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f0b13706-ef19-4af5-971a-84b8dd585f1f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:03.191822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f0b13706-ef19-4af5-971a-84b8dd585f1f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:03.199496 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f0b13706-ef19-4af5-971a-84b8dd585f1f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:03.199978 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f0b13706-ef19-4af5-971a-84b8dd585f1f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:03.200406 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f0b13706-ef19-4af5-971a-84b8dd585f1f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:03.201146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f0b13706-ef19-4af5-971a-84b8dd585f1f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:03.201595 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f0b13706-ef19-4af5-971a-84b8dd585f1f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:03.202015 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f0b13706-ef19-4af5-971a-84b8dd585f1f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:03.339581 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f0b13706-ef19-4af5-971a-84b8dd585f1f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:03.347968 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f0b13706-ef19-4af5-971a-84b8dd585f1f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:03.349504 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f0b13706-ef19-4af5-971a-84b8dd585f1f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:03.350640 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f0b13706-ef19-4af5-971a-84b8dd585f1f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.164458 Aug 05 07:18:03.351205 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 201/411] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:03 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:04.373664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-990bc50a-5b7f-4934-bd00-7145c7e0905a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:04.374385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-990bc50a-5b7f-4934-bd00-7145c7e0905a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:04.381574 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-990bc50a-5b7f-4934-bd00-7145c7e0905a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:04.382055 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-990bc50a-5b7f-4934-bd00-7145c7e0905a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:04.382497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-990bc50a-5b7f-4934-bd00-7145c7e0905a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:04.383200 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-990bc50a-5b7f-4934-bd00-7145c7e0905a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:04.383655 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-990bc50a-5b7f-4934-bd00-7145c7e0905a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:04.384080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-990bc50a-5b7f-4934-bd00-7145c7e0905a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:04.537078 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-990bc50a-5b7f-4934-bd00-7145c7e0905a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:04.546264 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-990bc50a-5b7f-4934-bd00-7145c7e0905a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:04.547818 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-990bc50a-5b7f-4934-bd00-7145c7e0905a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:04.549070 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-990bc50a-5b7f-4934-bd00-7145c7e0905a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.179374 Aug 05 07:18:04.549651 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 211/412] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:04 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:05.572610 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b24551f8-4f04-424f-a17f-259f73111741 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:05.573306 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b24551f8-4f04-424f-a17f-259f73111741 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:05.580097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b24551f8-4f04-424f-a17f-259f73111741 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:05.580583 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b24551f8-4f04-424f-a17f-259f73111741 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:05.581029 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b24551f8-4f04-424f-a17f-259f73111741 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:05.581722 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b24551f8-4f04-424f-a17f-259f73111741 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:05.582170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b24551f8-4f04-424f-a17f-259f73111741 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:05.582594 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b24551f8-4f04-424f-a17f-259f73111741 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:05.719391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b24551f8-4f04-424f-a17f-259f73111741 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:05.727533 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b24551f8-4f04-424f-a17f-259f73111741 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:05.729066 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b24551f8-4f04-424f-a17f-259f73111741 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:05.730248 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b24551f8-4f04-424f-a17f-259f73111741 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.161768 Aug 05 07:18:05.730812 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 202/413] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:05 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:06.755650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-cfd9988c-6a92-4abf-b353-c99f1f5cc89e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:06.756282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-cfd9988c-6a92-4abf-b353-c99f1f5cc89e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:06.763241 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cfd9988c-6a92-4abf-b353-c99f1f5cc89e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:06.763728 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cfd9988c-6a92-4abf-b353-c99f1f5cc89e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:06.764162 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cfd9988c-6a92-4abf-b353-c99f1f5cc89e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:06.764858 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cfd9988c-6a92-4abf-b353-c99f1f5cc89e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:06.765351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cfd9988c-6a92-4abf-b353-c99f1f5cc89e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:06.765781 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cfd9988c-6a92-4abf-b353-c99f1f5cc89e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:06.784515 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:06.901644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cfd9988c-6a92-4abf-b353-c99f1f5cc89e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:06.910304 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cfd9988c-6a92-4abf-b353-c99f1f5cc89e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:06.911799 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cfd9988c-6a92-4abf-b353-c99f1f5cc89e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:06.912996 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-cfd9988c-6a92-4abf-b353-c99f1f5cc89e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.161323 Aug 05 07:18:06.913549 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 212/414] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:06 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:07.936421 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-73458545-e8b9-4a38-851d-5b2b9f801b2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:07.937105 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-73458545-e8b9-4a38-851d-5b2b9f801b2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:07.944119 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73458545-e8b9-4a38-851d-5b2b9f801b2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:07.944598 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73458545-e8b9-4a38-851d-5b2b9f801b2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:07.945034 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73458545-e8b9-4a38-851d-5b2b9f801b2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:07.945748 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73458545-e8b9-4a38-851d-5b2b9f801b2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:07.946187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73458545-e8b9-4a38-851d-5b2b9f801b2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:07.946603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73458545-e8b9-4a38-851d-5b2b9f801b2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:08.086046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-73458545-e8b9-4a38-851d-5b2b9f801b2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:08.094564 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-73458545-e8b9-4a38-851d-5b2b9f801b2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:08.096060 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-73458545-e8b9-4a38-851d-5b2b9f801b2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:08.097275 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-73458545-e8b9-4a38-851d-5b2b9f801b2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.164950 Aug 05 07:18:08.097842 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 203/415] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:07 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:09.120000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-816253b8-2c55-4f49-aa17-af9b84928103 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:09.120696 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-816253b8-2c55-4f49-aa17-af9b84928103 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:09.127612 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-816253b8-2c55-4f49-aa17-af9b84928103 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:09.128090 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-816253b8-2c55-4f49-aa17-af9b84928103 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:09.128526 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-816253b8-2c55-4f49-aa17-af9b84928103 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:09.129252 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-816253b8-2c55-4f49-aa17-af9b84928103 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:09.129679 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-816253b8-2c55-4f49-aa17-af9b84928103 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:09.130129 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-816253b8-2c55-4f49-aa17-af9b84928103 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:09.271334 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-816253b8-2c55-4f49-aa17-af9b84928103 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:09.282227 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-816253b8-2c55-4f49-aa17-af9b84928103 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:09.284552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-816253b8-2c55-4f49-aa17-af9b84928103 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:09.286622 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-816253b8-2c55-4f49-aa17-af9b84928103 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.170424 Aug 05 07:18:09.287474 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 213/416] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:09 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:10.311046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d1e601a2-94b4-4f97-8337-88f29129df38 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:10.311668 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d1e601a2-94b4-4f97-8337-88f29129df38 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:10.319035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d1e601a2-94b4-4f97-8337-88f29129df38 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:10.319554 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d1e601a2-94b4-4f97-8337-88f29129df38 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:10.319979 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d1e601a2-94b4-4f97-8337-88f29129df38 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:10.320729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d1e601a2-94b4-4f97-8337-88f29129df38 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:10.321219 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d1e601a2-94b4-4f97-8337-88f29129df38 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:10.321648 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d1e601a2-94b4-4f97-8337-88f29129df38 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:10.458541 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d1e601a2-94b4-4f97-8337-88f29129df38 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:10.466786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d1e601a2-94b4-4f97-8337-88f29129df38 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:10.468319 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d1e601a2-94b4-4f97-8337-88f29129df38 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:10.469583 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d1e601a2-94b4-4f97-8337-88f29129df38 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.162775 Aug 05 07:18:10.470153 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 204/417] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:10 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:11.493915 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3719ea23-e355-4f20-ac76-dd403c5b630b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:11.494615 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3719ea23-e355-4f20-ac76-dd403c5b630b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:11.501721 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3719ea23-e355-4f20-ac76-dd403c5b630b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:11.502200 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3719ea23-e355-4f20-ac76-dd403c5b630b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:11.502637 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3719ea23-e355-4f20-ac76-dd403c5b630b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:11.503326 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3719ea23-e355-4f20-ac76-dd403c5b630b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:11.503783 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3719ea23-e355-4f20-ac76-dd403c5b630b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:11.504210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3719ea23-e355-4f20-ac76-dd403c5b630b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:11.646725 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3719ea23-e355-4f20-ac76-dd403c5b630b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:11.659912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3719ea23-e355-4f20-ac76-dd403c5b630b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:11.662146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3719ea23-e355-4f20-ac76-dd403c5b630b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:11.663815 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3719ea23-e355-4f20-ac76-dd403c5b630b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.173692 Aug 05 07:18:11.664615 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 214/418] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:11 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:12.687632 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2b4fdd35-b01d-4efb-a722-d51a57088b3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:12.688244 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2b4fdd35-b01d-4efb-a722-d51a57088b3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:12.691005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=32 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:12.697516 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b4fdd35-b01d-4efb-a722-d51a57088b3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:12.698005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b4fdd35-b01d-4efb-a722-d51a57088b3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:12.698442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b4fdd35-b01d-4efb-a722-d51a57088b3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:12.699153 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b4fdd35-b01d-4efb-a722-d51a57088b3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:12.699608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b4fdd35-b01d-4efb-a722-d51a57088b3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:12.700031 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b4fdd35-b01d-4efb-a722-d51a57088b3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:12.836553 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2b4fdd35-b01d-4efb-a722-d51a57088b3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:12.844979 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2b4fdd35-b01d-4efb-a722-d51a57088b3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:12.846481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2b4fdd35-b01d-4efb-a722-d51a57088b3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:12.847689 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2b4fdd35-b01d-4efb-a722-d51a57088b3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.164236 Aug 05 07:18:12.848256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 205/419] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:12 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:13.870656 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-cfebe3f2-7ff1-4fa8-89db-a90a063f0d98 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:13.871311 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-cfebe3f2-7ff1-4fa8-89db-a90a063f0d98 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:13.878137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cfebe3f2-7ff1-4fa8-89db-a90a063f0d98 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:13.878612 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cfebe3f2-7ff1-4fa8-89db-a90a063f0d98 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:13.879039 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cfebe3f2-7ff1-4fa8-89db-a90a063f0d98 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:13.879735 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cfebe3f2-7ff1-4fa8-89db-a90a063f0d98 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:13.880176 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cfebe3f2-7ff1-4fa8-89db-a90a063f0d98 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:13.880601 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cfebe3f2-7ff1-4fa8-89db-a90a063f0d98 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:14.024350 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cfebe3f2-7ff1-4fa8-89db-a90a063f0d98 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:14.032831 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cfebe3f2-7ff1-4fa8-89db-a90a063f0d98 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:14.034426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cfebe3f2-7ff1-4fa8-89db-a90a063f0d98 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:14.035583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-cfebe3f2-7ff1-4fa8-89db-a90a063f0d98 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.169119 Aug 05 07:18:14.036163 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 215/420] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:13 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:15.060475 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-44b89ea5-ff6a-46c0-93aa-c5e9ca675b61 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:15.061156 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-44b89ea5-ff6a-46c0-93aa-c5e9ca675b61 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:15.069231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44b89ea5-ff6a-46c0-93aa-c5e9ca675b61 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:15.069709 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44b89ea5-ff6a-46c0-93aa-c5e9ca675b61 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:15.070136 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44b89ea5-ff6a-46c0-93aa-c5e9ca675b61 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:15.071277 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44b89ea5-ff6a-46c0-93aa-c5e9ca675b61 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:15.071775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44b89ea5-ff6a-46c0-93aa-c5e9ca675b61 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:15.072192 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44b89ea5-ff6a-46c0-93aa-c5e9ca675b61 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:15.212708 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-44b89ea5-ff6a-46c0-93aa-c5e9ca675b61 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:15.221220 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-44b89ea5-ff6a-46c0-93aa-c5e9ca675b61 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:15.222708 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-44b89ea5-ff6a-46c0-93aa-c5e9ca675b61 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:15.223860 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-44b89ea5-ff6a-46c0-93aa-c5e9ca675b61 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.167535 Aug 05 07:18:15.224421 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 206/421] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:15 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:16.246849 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e7b745fb-d603-4a86-8f38-018590ee0d68 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:16.247455 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e7b745fb-d603-4a86-8f38-018590ee0d68 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:16.254432 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7b745fb-d603-4a86-8f38-018590ee0d68 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:16.254916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7b745fb-d603-4a86-8f38-018590ee0d68 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:16.255356 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7b745fb-d603-4a86-8f38-018590ee0d68 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:16.256054 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7b745fb-d603-4a86-8f38-018590ee0d68 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:16.256535 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7b745fb-d603-4a86-8f38-018590ee0d68 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:16.256950 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7b745fb-d603-4a86-8f38-018590ee0d68 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:16.388940 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e7b745fb-d603-4a86-8f38-018590ee0d68 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:16.398029 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e7b745fb-d603-4a86-8f38-018590ee0d68 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:16.399557 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e7b745fb-d603-4a86-8f38-018590ee0d68 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:16.400728 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e7b745fb-d603-4a86-8f38-018590ee0d68 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.157904 Aug 05 07:18:16.401332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 216/422] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:16 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:17.423509 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bb135274-7f02-4c2f-9be4-716a1e83f86a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:17.424086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bb135274-7f02-4c2f-9be4-716a1e83f86a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:17.431113 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb135274-7f02-4c2f-9be4-716a1e83f86a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:17.431583 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb135274-7f02-4c2f-9be4-716a1e83f86a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:17.432030 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb135274-7f02-4c2f-9be4-716a1e83f86a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:17.432720 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb135274-7f02-4c2f-9be4-716a1e83f86a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:17.433208 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb135274-7f02-4c2f-9be4-716a1e83f86a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:17.433632 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb135274-7f02-4c2f-9be4-716a1e83f86a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:17.565026 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bb135274-7f02-4c2f-9be4-716a1e83f86a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:17.573391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bb135274-7f02-4c2f-9be4-716a1e83f86a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:17.574896 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bb135274-7f02-4c2f-9be4-716a1e83f86a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:17.576055 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bb135274-7f02-4c2f-9be4-716a1e83f86a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.156825 Aug 05 07:18:17.576664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 207/423] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:17 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:18.599299 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-cb876986-36b3-4082-80ef-caa3cc395dba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:18.599897 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-cb876986-36b3-4082-80ef-caa3cc395dba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:18.602062 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=26 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:18.607837 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cb876986-36b3-4082-80ef-caa3cc395dba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:18.608322 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cb876986-36b3-4082-80ef-caa3cc395dba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:18.608755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cb876986-36b3-4082-80ef-caa3cc395dba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:18.609493 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cb876986-36b3-4082-80ef-caa3cc395dba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:18.609949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cb876986-36b3-4082-80ef-caa3cc395dba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:18.610440 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cb876986-36b3-4082-80ef-caa3cc395dba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:18.750735 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cb876986-36b3-4082-80ef-caa3cc395dba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:18.758990 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cb876986-36b3-4082-80ef-caa3cc395dba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:18.760505 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cb876986-36b3-4082-80ef-caa3cc395dba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:18.761702 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-cb876986-36b3-4082-80ef-caa3cc395dba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.166523 Aug 05 07:18:18.762281 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 217/424] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:18 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:19.785653 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-98b07245-c467-4713-9aad-fd5176e6a478 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:19.786186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-98b07245-c467-4713-9aad-fd5176e6a478 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:19.792721 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-98b07245-c467-4713-9aad-fd5176e6a478 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:19.793237 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-98b07245-c467-4713-9aad-fd5176e6a478 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:19.793666 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-98b07245-c467-4713-9aad-fd5176e6a478 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:19.794372 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-98b07245-c467-4713-9aad-fd5176e6a478 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:19.794810 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-98b07245-c467-4713-9aad-fd5176e6a478 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:19.795231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-98b07245-c467-4713-9aad-fd5176e6a478 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:19.931531 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-98b07245-c467-4713-9aad-fd5176e6a478 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:19.942482 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-98b07245-c467-4713-9aad-fd5176e6a478 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:19.944481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-98b07245-c467-4713-9aad-fd5176e6a478 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:19.946188 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-98b07245-c467-4713-9aad-fd5176e6a478 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1744 microversion: 2.20 time: 0.164739 Aug 05 07:18:19.947082 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 208/425] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:19 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:20.481629 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-51d9caaa-c112-49aa-be33-d739aa68fdc9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e0c3d1b-f220-4931-9b0f-8b2101b36aed"}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:18:20.484784 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-51d9caaa-c112-49aa-be33-d739aa68fdc9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:20.492278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-51d9caaa-c112-49aa-be33-d739aa68fdc9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:20.492764 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-51d9caaa-c112-49aa-be33-d739aa68fdc9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:20.493235 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-51d9caaa-c112-49aa-be33-d739aa68fdc9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:20.494104 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-51d9caaa-c112-49aa-be33-d739aa68fdc9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:20.495128 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-51d9caaa-c112-49aa-be33-d739aa68fdc9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:20.495128 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-51d9caaa-c112-49aa-be33-d739aa68fdc9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:20.792675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-51d9caaa-c112-49aa-be33-d739aa68fdc9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "POST /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314992 Aug 05 07:18:20.793484 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 218/426] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:18:20 2022] POST /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:18:20.972227 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c9751904-0e34-4fc4-94fc-c6684cd54818 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:20.972836 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c9751904-0e34-4fc4-94fc-c6684cd54818 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:20.980164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c9751904-0e34-4fc4-94fc-c6684cd54818 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:20.980704 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c9751904-0e34-4fc4-94fc-c6684cd54818 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:20.981153 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c9751904-0e34-4fc4-94fc-c6684cd54818 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:20.981864 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c9751904-0e34-4fc4-94fc-c6684cd54818 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:20.982290 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c9751904-0e34-4fc4-94fc-c6684cd54818 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:20.982718 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c9751904-0e34-4fc4-94fc-c6684cd54818 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:21.121824 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c9751904-0e34-4fc4-94fc-c6684cd54818 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:21.130971 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c9751904-0e34-4fc4-94fc-c6684cd54818 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:21.132473 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c9751904-0e34-4fc4-94fc-c6684cd54818 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:21.133701 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c9751904-0e34-4fc4-94fc-c6684cd54818 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1744 microversion: 2.20 time: 0.165769 Aug 05 07:18:21.134272 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 209/427] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:20 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:22.158675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-cba6f71c-cfa2-4277-962e-093596e726a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:22.159259 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-cba6f71c-cfa2-4277-962e-093596e726a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:22.165980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cba6f71c-cfa2-4277-962e-093596e726a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:22.166458 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cba6f71c-cfa2-4277-962e-093596e726a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:22.166879 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cba6f71c-cfa2-4277-962e-093596e726a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:22.167575 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cba6f71c-cfa2-4277-962e-093596e726a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:22.167994 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cba6f71c-cfa2-4277-962e-093596e726a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:22.168406 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cba6f71c-cfa2-4277-962e-093596e726a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:22.306750 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cba6f71c-cfa2-4277-962e-093596e726a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:22.318006 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cba6f71c-cfa2-4277-962e-093596e726a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:22.320070 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cba6f71c-cfa2-4277-962e-093596e726a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:22.321605 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-cba6f71c-cfa2-4277-962e-093596e726a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1744 microversion: 2.20 time: 0.167962 Aug 05 07:18:22.322222 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 219/428] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:22 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:23.345631 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a0a5187c-a171-4822-8772-a80891607b70 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:23.346536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a0a5187c-a171-4822-8772-a80891607b70 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:23.353642 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0a5187c-a171-4822-8772-a80891607b70 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:23.354108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0a5187c-a171-4822-8772-a80891607b70 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:23.354541 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0a5187c-a171-4822-8772-a80891607b70 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:23.355265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0a5187c-a171-4822-8772-a80891607b70 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:23.355720 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0a5187c-a171-4822-8772-a80891607b70 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:23.356141 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0a5187c-a171-4822-8772-a80891607b70 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:23.498007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0a5187c-a171-4822-8772-a80891607b70 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:23.506523 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0a5187c-a171-4822-8772-a80891607b70 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:23.508049 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0a5187c-a171-4822-8772-a80891607b70 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:23.509235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a0a5187c-a171-4822-8772-a80891607b70 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1744 microversion: 2.20 time: 0.168073 Aug 05 07:18:23.509917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 210/429] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:23 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:23.856037 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-1ee27925-6145-4d4a-9f54-630d2db61309 req-b1c95bb0-5968-4981-9434-921096328fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f664511a-28db-4ff6-90e9-7e2db58e94e2", "name": "network-vif-plugged", "status": "completed", "tag": "986a1785-c18c-444a-af3e-101b2ea68ae7"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:18:23.868091 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-1ee27925-6145-4d4a-9f54-630d2db61309 req-b1c95bb0-5968-4981-9434-921096328fec service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:23.868720 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-1ee27925-6145-4d4a-9f54-630d2db61309 req-b1c95bb0-5968-4981-9434-921096328fec service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:23.869186 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-1ee27925-6145-4d4a-9f54-630d2db61309 req-b1c95bb0-5968-4981-9434-921096328fec service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:23.880762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-1ee27925-6145-4d4a-9f54-630d2db61309 req-b1c95bb0-5968-4981-9434-921096328fec service nova] Creating event network-vif-plugged:986a1785-c18c-444a-af3e-101b2ea68ae7 for instance f664511a-28db-4ff6-90e9-7e2db58e94e2 on hv-cinder-85200 Aug 05 07:18:23.885871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-1ee27925-6145-4d4a-9f54-630d2db61309 req-b1c95bb0-5968-4981-9434-921096328fec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033625 Aug 05 07:18:23.886744 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 220/430] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:18:24.532971 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cf091f13-ce41-46ae-acc7-c91045adb8ad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:24.533544 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cf091f13-ce41-46ae-acc7-c91045adb8ad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:24.540495 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cf091f13-ce41-46ae-acc7-c91045adb8ad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:24.541012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cf091f13-ce41-46ae-acc7-c91045adb8ad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:24.541444 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cf091f13-ce41-46ae-acc7-c91045adb8ad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:24.542143 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cf091f13-ce41-46ae-acc7-c91045adb8ad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:24.542603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cf091f13-ce41-46ae-acc7-c91045adb8ad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:24.542991 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cf091f13-ce41-46ae-acc7-c91045adb8ad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:24.675458 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cf091f13-ce41-46ae-acc7-c91045adb8ad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:24.683602 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cf091f13-ce41-46ae-acc7-c91045adb8ad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:24.685163 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cf091f13-ce41-46ae-acc7-c91045adb8ad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:24.686319 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cf091f13-ce41-46ae-acc7-c91045adb8ad tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1744 microversion: 2.20 time: 0.157467 Aug 05 07:18:24.686943 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 211/431] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:24 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:25.709216 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-342b3f79-9ca2-4f78-9440-379cae288056 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:25.709911 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-342b3f79-9ca2-4f78-9440-379cae288056 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:25.717004 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-342b3f79-9ca2-4f78-9440-379cae288056 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:25.717485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-342b3f79-9ca2-4f78-9440-379cae288056 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:25.717918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-342b3f79-9ca2-4f78-9440-379cae288056 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:25.718606 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-342b3f79-9ca2-4f78-9440-379cae288056 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:25.719052 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-342b3f79-9ca2-4f78-9440-379cae288056 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:25.719581 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-342b3f79-9ca2-4f78-9440-379cae288056 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:25.863923 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-342b3f79-9ca2-4f78-9440-379cae288056 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:25.872317 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-342b3f79-9ca2-4f78-9440-379cae288056 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:25.873836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-342b3f79-9ca2-4f78-9440-379cae288056 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:25.874999 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-342b3f79-9ca2-4f78-9440-379cae288056 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1744 microversion: 2.20 time: 0.170183 Aug 05 07:18:25.875595 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 221/432] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:25 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:26.898348 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9b8f6dad-d151-4d54-ad91-0f2bae2cd639 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:26.900133 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9b8f6dad-d151-4d54-ad91-0f2bae2cd639 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:26.907776 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b8f6dad-d151-4d54-ad91-0f2bae2cd639 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:26.908329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b8f6dad-d151-4d54-ad91-0f2bae2cd639 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:26.909128 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b8f6dad-d151-4d54-ad91-0f2bae2cd639 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:26.910202 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b8f6dad-d151-4d54-ad91-0f2bae2cd639 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:26.911263 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b8f6dad-d151-4d54-ad91-0f2bae2cd639 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:26.911702 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b8f6dad-d151-4d54-ad91-0f2bae2cd639 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:27.099004 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9b8f6dad-d151-4d54-ad91-0f2bae2cd639 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:27.110184 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9b8f6dad-d151-4d54-ad91-0f2bae2cd639 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:27.111672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9b8f6dad-d151-4d54-ad91-0f2bae2cd639 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:27.116036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9b8f6dad-d151-4d54-ad91-0f2bae2cd639 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1739 microversion: 2.20 time: 0.220974 Aug 05 07:18:27.118113 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 212/433] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:26 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:28.139796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9bc94d22-88e3-4d96-b76c-e56474803d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:28.140562 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9bc94d22-88e3-4d96-b76c-e56474803d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:28.149387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9bc94d22-88e3-4d96-b76c-e56474803d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:28.150259 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9bc94d22-88e3-4d96-b76c-e56474803d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:28.151475 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9bc94d22-88e3-4d96-b76c-e56474803d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:28.152603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9bc94d22-88e3-4d96-b76c-e56474803d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:28.153431 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9bc94d22-88e3-4d96-b76c-e56474803d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:28.154051 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9bc94d22-88e3-4d96-b76c-e56474803d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:28.384238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9bc94d22-88e3-4d96-b76c-e56474803d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:28.395904 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9bc94d22-88e3-4d96-b76c-e56474803d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:28.398083 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9bc94d22-88e3-4d96-b76c-e56474803d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:28.399887 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9bc94d22-88e3-4d96-b76c-e56474803d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1739 microversion: 2.20 time: 0.263775 Aug 05 07:18:28.401718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 222/434] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:28 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:28.431313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-40757b49-54fa-48cd-83e5-7f4e2648bd33 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:18:28.434430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-40757b49-54fa-48cd-83e5-7f4e2648bd33 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:28.442815 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40757b49-54fa-48cd-83e5-7f4e2648bd33 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:28.443711 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40757b49-54fa-48cd-83e5-7f4e2648bd33 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:28.444364 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40757b49-54fa-48cd-83e5-7f4e2648bd33 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:28.445337 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40757b49-54fa-48cd-83e5-7f4e2648bd33 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:28.445998 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40757b49-54fa-48cd-83e5-7f4e2648bd33 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:28.446628 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40757b49-54fa-48cd-83e5-7f4e2648bd33 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:28.475198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-40757b49-54fa-48cd-83e5-7f4e2648bd33 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lazy-loading 'flavor' on Instance uuid 93d20686-267a-4bf7-b36b-7a248b0c3d8d {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:18:28.648280 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-40757b49-54fa-48cd-83e5-7f4e2648bd33 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "POST /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/action" status: 200 len: 32 microversion: 2.1 time: 0.221534 Aug 05 07:18:28.648860 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 213/435] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:18:28 2022] POST /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/action => generated 32 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 07:18:28.668127 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-58c3bdc1-5251-4d22-8c40-4a1da87d7ed0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:28.668955 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-58c3bdc1-5251-4d22-8c40-4a1da87d7ed0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:28.677202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-58c3bdc1-5251-4d22-8c40-4a1da87d7ed0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:28.677993 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-58c3bdc1-5251-4d22-8c40-4a1da87d7ed0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:28.678668 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-58c3bdc1-5251-4d22-8c40-4a1da87d7ed0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:28.679560 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-58c3bdc1-5251-4d22-8c40-4a1da87d7ed0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:28.680183 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-58c3bdc1-5251-4d22-8c40-4a1da87d7ed0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:28.680808 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-58c3bdc1-5251-4d22-8c40-4a1da87d7ed0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:28.908441 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-58c3bdc1-5251-4d22-8c40-4a1da87d7ed0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:28.924255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-58c3bdc1-5251-4d22-8c40-4a1da87d7ed0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.268471 Aug 05 07:18:28.925479 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 223/436] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:28 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:29.425015 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b49438e5-436d-4a4b-962b-84511300d9a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:29.426184 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b49438e5-436d-4a4b-962b-84511300d9a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:29.433819 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b49438e5-436d-4a4b-962b-84511300d9a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:29.435078 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b49438e5-436d-4a4b-962b-84511300d9a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:29.435685 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b49438e5-436d-4a4b-962b-84511300d9a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:29.436831 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b49438e5-436d-4a4b-962b-84511300d9a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:29.437461 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b49438e5-436d-4a4b-962b-84511300d9a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:29.438393 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b49438e5-436d-4a4b-962b-84511300d9a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:29.460978 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:29.623519 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b49438e5-436d-4a4b-962b-84511300d9a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:29.634464 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b49438e5-436d-4a4b-962b-84511300d9a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:29.636830 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b49438e5-436d-4a4b-962b-84511300d9a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:29.638593 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b49438e5-436d-4a4b-962b-84511300d9a0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1739 microversion: 2.20 time: 0.219105 Aug 05 07:18:29.651937 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 214/437] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:29 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:29.946064 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f7a3eb91-5254-436e-8298-21209e475f48 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:29.946818 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f7a3eb91-5254-436e-8298-21209e475f48 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:29.957077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f7a3eb91-5254-436e-8298-21209e475f48 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:29.957547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f7a3eb91-5254-436e-8298-21209e475f48 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:29.957962 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f7a3eb91-5254-436e-8298-21209e475f48 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:29.958916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f7a3eb91-5254-436e-8298-21209e475f48 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:29.959521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f7a3eb91-5254-436e-8298-21209e475f48 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:29.960125 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f7a3eb91-5254-436e-8298-21209e475f48 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:30.126164 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f7a3eb91-5254-436e-8298-21209e475f48 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:30.135073 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f7a3eb91-5254-436e-8298-21209e475f48 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.192910 Aug 05 07:18:30.136321 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 224/438] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:29 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:30.670853 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-aeb28d7b-65ea-4631-a167-65439e8c89bf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:30.672167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-aeb28d7b-65ea-4631-a167-65439e8c89bf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:30.678808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aeb28d7b-65ea-4631-a167-65439e8c89bf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:30.679527 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aeb28d7b-65ea-4631-a167-65439e8c89bf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:30.679951 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aeb28d7b-65ea-4631-a167-65439e8c89bf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:30.680639 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aeb28d7b-65ea-4631-a167-65439e8c89bf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:30.681106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aeb28d7b-65ea-4631-a167-65439e8c89bf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:30.681761 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aeb28d7b-65ea-4631-a167-65439e8c89bf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:30.841480 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aeb28d7b-65ea-4631-a167-65439e8c89bf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:30.850284 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aeb28d7b-65ea-4631-a167-65439e8c89bf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:30.851833 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aeb28d7b-65ea-4631-a167-65439e8c89bf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:30.853043 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-aeb28d7b-65ea-4631-a167-65439e8c89bf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1739 microversion: 2.20 time: 0.186346 Aug 05 07:18:30.853627 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 215/439] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:30 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:31.157917 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d1bc4ea9-cc29-4e4d-b476-3263acc1a3bd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:31.158540 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d1bc4ea9-cc29-4e4d-b476-3263acc1a3bd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:31.165117 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d1bc4ea9-cc29-4e4d-b476-3263acc1a3bd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:31.165959 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d1bc4ea9-cc29-4e4d-b476-3263acc1a3bd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:31.166598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d1bc4ea9-cc29-4e4d-b476-3263acc1a3bd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:31.167299 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d1bc4ea9-cc29-4e4d-b476-3263acc1a3bd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:31.167745 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d1bc4ea9-cc29-4e4d-b476-3263acc1a3bd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:31.168160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d1bc4ea9-cc29-4e4d-b476-3263acc1a3bd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:31.309861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d1bc4ea9-cc29-4e4d-b476-3263acc1a3bd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:31.322457 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d1bc4ea9-cc29-4e4d-b476-3263acc1a3bd tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.168856 Aug 05 07:18:31.324021 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 225/440] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:31 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:31.877365 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3819a894-c9f3-4921-a9a3-78df973a3b07 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:31.878869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3819a894-c9f3-4921-a9a3-78df973a3b07 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:31.886373 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3819a894-c9f3-4921-a9a3-78df973a3b07 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:31.887146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3819a894-c9f3-4921-a9a3-78df973a3b07 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:31.887718 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3819a894-c9f3-4921-a9a3-78df973a3b07 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:31.888649 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3819a894-c9f3-4921-a9a3-78df973a3b07 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:31.889107 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3819a894-c9f3-4921-a9a3-78df973a3b07 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:31.889690 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3819a894-c9f3-4921-a9a3-78df973a3b07 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:32.060944 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3819a894-c9f3-4921-a9a3-78df973a3b07 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:32.073647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3819a894-c9f3-4921-a9a3-78df973a3b07 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:32.075158 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3819a894-c9f3-4921-a9a3-78df973a3b07 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:32.076350 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3819a894-c9f3-4921-a9a3-78df973a3b07 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1739 microversion: 2.20 time: 0.203522 Aug 05 07:18:32.092292 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 216/441] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:31 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:32.345000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-589a2523-54a0-4360-8edd-e4f9c2d9a9ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:32.345613 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-589a2523-54a0-4360-8edd-e4f9c2d9a9ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:32.352316 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-589a2523-54a0-4360-8edd-e4f9c2d9a9ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:32.352839 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-589a2523-54a0-4360-8edd-e4f9c2d9a9ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:32.353342 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-589a2523-54a0-4360-8edd-e4f9c2d9a9ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:32.354086 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-589a2523-54a0-4360-8edd-e4f9c2d9a9ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:32.354529 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-589a2523-54a0-4360-8edd-e4f9c2d9a9ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:32.354977 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-589a2523-54a0-4360-8edd-e4f9c2d9a9ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:32.523733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-589a2523-54a0-4360-8edd-e4f9c2d9a9ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:32.534395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-589a2523-54a0-4360-8edd-e4f9c2d9a9ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.194100 Aug 05 07:18:32.537776 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 226/442] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:32 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:33.101344 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-66ab5b92-273f-48b9-940d-37ff36ab06f0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:33.102628 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-66ab5b92-273f-48b9-940d-37ff36ab06f0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:33.110152 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-66ab5b92-273f-48b9-940d-37ff36ab06f0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:33.110627 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-66ab5b92-273f-48b9-940d-37ff36ab06f0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:33.111055 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-66ab5b92-273f-48b9-940d-37ff36ab06f0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:33.111741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-66ab5b92-273f-48b9-940d-37ff36ab06f0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:33.112182 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-66ab5b92-273f-48b9-940d-37ff36ab06f0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:33.112592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-66ab5b92-273f-48b9-940d-37ff36ab06f0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:33.279867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-66ab5b92-273f-48b9-940d-37ff36ab06f0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:33.291891 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-66ab5b92-273f-48b9-940d-37ff36ab06f0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:33.293664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-66ab5b92-273f-48b9-940d-37ff36ab06f0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:33.294929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-66ab5b92-273f-48b9-940d-37ff36ab06f0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1739 microversion: 2.20 time: 0.198855 Aug 05 07:18:33.295560 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 217/443] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:33 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:33.557253 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8de77cac-97e6-4545-90fd-c06e52e8a395 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:33.557854 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8de77cac-97e6-4545-90fd-c06e52e8a395 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:33.573489 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8de77cac-97e6-4545-90fd-c06e52e8a395 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:33.575356 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8de77cac-97e6-4545-90fd-c06e52e8a395 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:33.575799 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8de77cac-97e6-4545-90fd-c06e52e8a395 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:33.576592 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8de77cac-97e6-4545-90fd-c06e52e8a395 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:33.577090 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8de77cac-97e6-4545-90fd-c06e52e8a395 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:33.577528 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8de77cac-97e6-4545-90fd-c06e52e8a395 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:33.746311 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-8de77cac-97e6-4545-90fd-c06e52e8a395 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:33.755323 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8de77cac-97e6-4545-90fd-c06e52e8a395 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.203782 Aug 05 07:18:33.761421 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 227/444] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:33 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:34.320979 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-318fede0-de7f-48f2-b501-d0fc3a72d8fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:34.322341 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-318fede0-de7f-48f2-b501-d0fc3a72d8fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:34.329645 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-318fede0-de7f-48f2-b501-d0fc3a72d8fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:34.330574 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-318fede0-de7f-48f2-b501-d0fc3a72d8fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:34.331305 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-318fede0-de7f-48f2-b501-d0fc3a72d8fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:34.332100 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-318fede0-de7f-48f2-b501-d0fc3a72d8fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:34.332618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-318fede0-de7f-48f2-b501-d0fc3a72d8fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:34.333159 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-318fede0-de7f-48f2-b501-d0fc3a72d8fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:34.526828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-318fede0-de7f-48f2-b501-d0fc3a72d8fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:34.537180 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-318fede0-de7f-48f2-b501-d0fc3a72d8fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:34.538575 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-318fede0-de7f-48f2-b501-d0fc3a72d8fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:34.539748 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-318fede0-de7f-48f2-b501-d0fc3a72d8fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1739 microversion: 2.20 time: 0.223225 Aug 05 07:18:34.540295 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 218/445] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:34 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:34.777766 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f76c1d1d-22b6-4e82-a84c-0658c319adbc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:34.778413 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f76c1d1d-22b6-4e82-a84c-0658c319adbc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:34.791180 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f76c1d1d-22b6-4e82-a84c-0658c319adbc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:34.791180 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f76c1d1d-22b6-4e82-a84c-0658c319adbc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:34.791180 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f76c1d1d-22b6-4e82-a84c-0658c319adbc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:34.791180 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f76c1d1d-22b6-4e82-a84c-0658c319adbc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:34.791633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f76c1d1d-22b6-4e82-a84c-0658c319adbc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:34.791633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f76c1d1d-22b6-4e82-a84c-0658c319adbc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:34.810438 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:34.994295 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f76c1d1d-22b6-4e82-a84c-0658c319adbc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:35.003985 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f76c1d1d-22b6-4e82-a84c-0658c319adbc tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.230275 Aug 05 07:18:35.013031 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 228/446] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:34 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:35.562535 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9dbb78dc-f398-422e-bb93-0d87b90336f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:35.563146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9dbb78dc-f398-422e-bb93-0d87b90336f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:35.570311 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9dbb78dc-f398-422e-bb93-0d87b90336f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:35.570777 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9dbb78dc-f398-422e-bb93-0d87b90336f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:35.571230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9dbb78dc-f398-422e-bb93-0d87b90336f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:35.571944 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9dbb78dc-f398-422e-bb93-0d87b90336f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:35.572396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9dbb78dc-f398-422e-bb93-0d87b90336f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:35.572813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9dbb78dc-f398-422e-bb93-0d87b90336f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:35.726217 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9dbb78dc-f398-422e-bb93-0d87b90336f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:35.734617 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9dbb78dc-f398-422e-bb93-0d87b90336f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:35.736382 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9dbb78dc-f398-422e-bb93-0d87b90336f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:35.737619 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9dbb78dc-f398-422e-bb93-0d87b90336f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1739 microversion: 2.20 time: 0.179466 Aug 05 07:18:35.738257 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 219/447] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:35 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:36.026312 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-468b3866-d2cd-4a72-bf9e-5c650d92b522 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:36.026981 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-468b3866-d2cd-4a72-bf9e-5c650d92b522 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:36.034364 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-468b3866-d2cd-4a72-bf9e-5c650d92b522 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:36.034852 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-468b3866-d2cd-4a72-bf9e-5c650d92b522 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:36.035288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-468b3866-d2cd-4a72-bf9e-5c650d92b522 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:36.035995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-468b3866-d2cd-4a72-bf9e-5c650d92b522 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:36.036447 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-468b3866-d2cd-4a72-bf9e-5c650d92b522 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:36.036871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-468b3866-d2cd-4a72-bf9e-5c650d92b522 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:36.167951 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-468b3866-d2cd-4a72-bf9e-5c650d92b522 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:36.176473 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-468b3866-d2cd-4a72-bf9e-5c650d92b522 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.154463 Aug 05 07:18:36.177054 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 229/448] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:36 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:36.761264 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e3a48a29-9e24-45de-bcf3-a5a445254d84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:36.761917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e3a48a29-9e24-45de-bcf3-a5a445254d84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:36.769197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3a48a29-9e24-45de-bcf3-a5a445254d84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:36.769688 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3a48a29-9e24-45de-bcf3-a5a445254d84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:36.770106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3a48a29-9e24-45de-bcf3-a5a445254d84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:36.770804 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3a48a29-9e24-45de-bcf3-a5a445254d84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:36.771614 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3a48a29-9e24-45de-bcf3-a5a445254d84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:36.772026 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3a48a29-9e24-45de-bcf3-a5a445254d84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:36.910249 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e3a48a29-9e24-45de-bcf3-a5a445254d84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:36.918961 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e3a48a29-9e24-45de-bcf3-a5a445254d84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:36.920423 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e3a48a29-9e24-45de-bcf3-a5a445254d84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:36.921598 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e3a48a29-9e24-45de-bcf3-a5a445254d84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1721 microversion: 2.20 time: 0.164482 Aug 05 07:18:36.922357 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 220/449] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:36 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:37.198310 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d4482709-e00a-4e8c-80ef-805a1f1e3454 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:37.198895 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d4482709-e00a-4e8c-80ef-805a1f1e3454 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:37.205853 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4482709-e00a-4e8c-80ef-805a1f1e3454 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:37.206333 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4482709-e00a-4e8c-80ef-805a1f1e3454 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:37.206783 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4482709-e00a-4e8c-80ef-805a1f1e3454 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:37.207474 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4482709-e00a-4e8c-80ef-805a1f1e3454 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:37.207924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4482709-e00a-4e8c-80ef-805a1f1e3454 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:37.208354 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4482709-e00a-4e8c-80ef-805a1f1e3454 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:37.409370 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d4482709-e00a-4e8c-80ef-805a1f1e3454 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:37.417694 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d4482709-e00a-4e8c-80ef-805a1f1e3454 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.223427 Aug 05 07:18:37.418269 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 230/450] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:37 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:37.945961 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-75709115-2b93-49bf-bb20-b6ba307099c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:37.946578 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-75709115-2b93-49bf-bb20-b6ba307099c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:37.953861 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-75709115-2b93-49bf-bb20-b6ba307099c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:37.954336 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-75709115-2b93-49bf-bb20-b6ba307099c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:37.954770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-75709115-2b93-49bf-bb20-b6ba307099c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:37.955469 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-75709115-2b93-49bf-bb20-b6ba307099c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:37.955918 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-75709115-2b93-49bf-bb20-b6ba307099c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:37.956345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-75709115-2b93-49bf-bb20-b6ba307099c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:38.092617 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-75709115-2b93-49bf-bb20-b6ba307099c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:38.101007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-75709115-2b93-49bf-bb20-b6ba307099c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:38.102479 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-75709115-2b93-49bf-bb20-b6ba307099c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:38.103647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-75709115-2b93-49bf-bb20-b6ba307099c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1721 microversion: 2.20 time: 0.161843 Aug 05 07:18:38.104223 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 221/451] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:37 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:38.439129 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-226ddd49-a78d-46fe-b242-53b624d4689f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:38.439723 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-226ddd49-a78d-46fe-b242-53b624d4689f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:38.446590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-226ddd49-a78d-46fe-b242-53b624d4689f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:38.447068 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-226ddd49-a78d-46fe-b242-53b624d4689f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:38.447494 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-226ddd49-a78d-46fe-b242-53b624d4689f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:38.448185 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-226ddd49-a78d-46fe-b242-53b624d4689f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:38.448654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-226ddd49-a78d-46fe-b242-53b624d4689f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:38.449088 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-226ddd49-a78d-46fe-b242-53b624d4689f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:38.586942 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-226ddd49-a78d-46fe-b242-53b624d4689f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:38.595482 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-226ddd49-a78d-46fe-b242-53b624d4689f tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.160263 Aug 05 07:18:38.596077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 231/452] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:38 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:39.127019 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ed1db5d7-1e80-485d-966d-59a1b2c19096 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:39.127606 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ed1db5d7-1e80-485d-966d-59a1b2c19096 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:39.134713 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed1db5d7-1e80-485d-966d-59a1b2c19096 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:39.135198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed1db5d7-1e80-485d-966d-59a1b2c19096 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:39.135626 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed1db5d7-1e80-485d-966d-59a1b2c19096 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:39.136317 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed1db5d7-1e80-485d-966d-59a1b2c19096 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:39.136772 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed1db5d7-1e80-485d-966d-59a1b2c19096 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:39.137220 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed1db5d7-1e80-485d-966d-59a1b2c19096 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:39.275206 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ed1db5d7-1e80-485d-966d-59a1b2c19096 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:39.290686 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ed1db5d7-1e80-485d-966d-59a1b2c19096 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:39.292223 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ed1db5d7-1e80-485d-966d-59a1b2c19096 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:39.293431 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ed1db5d7-1e80-485d-966d-59a1b2c19096 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1721 microversion: 2.20 time: 0.170550 Aug 05 07:18:39.294007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 222/453] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:39 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:39.617080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-204eaae3-0e91-4118-898e-c362652707ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:39.617702 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-204eaae3-0e91-4118-898e-c362652707ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:39.624777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-204eaae3-0e91-4118-898e-c362652707ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:39.625277 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-204eaae3-0e91-4118-898e-c362652707ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:39.625714 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-204eaae3-0e91-4118-898e-c362652707ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:39.626447 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-204eaae3-0e91-4118-898e-c362652707ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:39.626904 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-204eaae3-0e91-4118-898e-c362652707ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:39.627332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-204eaae3-0e91-4118-898e-c362652707ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:39.760387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-204eaae3-0e91-4118-898e-c362652707ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:39.770072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-204eaae3-0e91-4118-898e-c362652707ff tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.156902 Aug 05 07:18:39.770656 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 232/454] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:39 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:39.915129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-d9e60de2-5dfb-4d26-b498-d21822d53281 req-909f65c6-ee24-4203-8b18-6036718479d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f664511a-28db-4ff6-90e9-7e2db58e94e2", "name": "network-vif-unplugged", "status": "completed", "tag": "986a1785-c18c-444a-af3e-101b2ea68ae7"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:18:39.925676 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d9e60de2-5dfb-4d26-b498-d21822d53281 req-909f65c6-ee24-4203-8b18-6036718479d7 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:39.926156 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d9e60de2-5dfb-4d26-b498-d21822d53281 req-909f65c6-ee24-4203-8b18-6036718479d7 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:39.926580 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d9e60de2-5dfb-4d26-b498-d21822d53281 req-909f65c6-ee24-4203-8b18-6036718479d7 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:39.938234 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.compute.server_external_events [req-d9e60de2-5dfb-4d26-b498-d21822d53281 req-909f65c6-ee24-4203-8b18-6036718479d7 service nova] Unable to find a host for instance f664511a-28db-4ff6-90e9-7e2db58e94e2. Dropping event network-vif-unplugged {{(pid=117893) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 07:18:39.939126 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-d9e60de2-5dfb-4d26-b498-d21822d53281 req-909f65c6-ee24-4203-8b18-6036718479d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030193 Aug 05 07:18:39.939948 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 223/455] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 05 07:18:40.322295 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-71dcfda2-1a8a-4844-a585-94a4dc7edd5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:40.322893 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-71dcfda2-1a8a-4844-a585-94a4dc7edd5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:40.329445 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-71dcfda2-1a8a-4844-a585-94a4dc7edd5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:40.329934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-71dcfda2-1a8a-4844-a585-94a4dc7edd5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:40.330366 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-71dcfda2-1a8a-4844-a585-94a4dc7edd5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:40.331058 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-71dcfda2-1a8a-4844-a585-94a4dc7edd5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:40.331509 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-71dcfda2-1a8a-4844-a585-94a4dc7edd5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:40.331935 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-71dcfda2-1a8a-4844-a585-94a4dc7edd5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:40.474036 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-71dcfda2-1a8a-4844-a585-94a4dc7edd5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:40.482690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-71dcfda2-1a8a-4844-a585-94a4dc7edd5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:40.484508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-71dcfda2-1a8a-4844-a585-94a4dc7edd5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:40.485714 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-71dcfda2-1a8a-4844-a585-94a4dc7edd5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1664 microversion: 2.20 time: 0.167469 Aug 05 07:18:40.486272 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 233/456] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:40 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:40.508321 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b95b79b7-9830-4c6c-8811-ab40f2eee63b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a88b1660-5fc3-4799-be91-17e8ef965272"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:18:40.510663 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b95b79b7-9830-4c6c-8811-ab40f2eee63b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:40.517674 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b95b79b7-9830-4c6c-8811-ab40f2eee63b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:40.518157 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b95b79b7-9830-4c6c-8811-ab40f2eee63b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:40.518586 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b95b79b7-9830-4c6c-8811-ab40f2eee63b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:40.519280 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b95b79b7-9830-4c6c-8811-ab40f2eee63b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:40.519722 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b95b79b7-9830-4c6c-8811-ab40f2eee63b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:40.520151 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b95b79b7-9830-4c6c-8811-ab40f2eee63b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:40.792965 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e8a81e70-065d-41ef-8dd4-b65bfc1d8a6a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:40.793691 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e8a81e70-065d-41ef-8dd4-b65bfc1d8a6a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:40.801111 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e8a81e70-065d-41ef-8dd4-b65bfc1d8a6a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:40.801590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e8a81e70-065d-41ef-8dd4-b65bfc1d8a6a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:40.802090 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e8a81e70-065d-41ef-8dd4-b65bfc1d8a6a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:40.802824 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e8a81e70-065d-41ef-8dd4-b65bfc1d8a6a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:40.803268 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e8a81e70-065d-41ef-8dd4-b65bfc1d8a6a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:40.803711 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e8a81e70-065d-41ef-8dd4-b65bfc1d8a6a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:40.828052 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b95b79b7-9830-4c6c-8811-ab40f2eee63b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "POST /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323663 Aug 05 07:18:40.828687 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 224/457] 10.222.0.27 () {62 vars in 1364 bytes} [Fri Aug 5 07:18:40 2022] POST /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:18:40.939224 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e8a81e70-065d-41ef-8dd4-b65bfc1d8a6a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:40.947880 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e8a81e70-065d-41ef-8dd4-b65bfc1d8a6a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.159393 Aug 05 07:18:40.948551 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 234/458] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:40 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:40.955082 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9bb0d386-7d3b-43a3-80e2-3ca20a2504fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:18:40.955778 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9bb0d386-7d3b-43a3-80e2-3ca20a2504fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:40.964513 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9bb0d386-7d3b-43a3-80e2-3ca20a2504fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:40.965028 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9bb0d386-7d3b-43a3-80e2-3ca20a2504fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:40.965457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9bb0d386-7d3b-43a3-80e2-3ca20a2504fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:40.966170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9bb0d386-7d3b-43a3-80e2-3ca20a2504fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:40.966618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9bb0d386-7d3b-43a3-80e2-3ca20a2504fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:40.967037 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9bb0d386-7d3b-43a3-80e2-3ca20a2504fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:41.015989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9bb0d386-7d3b-43a3-80e2-3ca20a2504fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117893) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 07:18:41.090043 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9bb0d386-7d3b-43a3-80e2-3ca20a2504fd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "POST /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/action" status: 202 len: 0 microversion: 2.20 time: 0.138999 Aug 05 07:18:41.090625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 225/459] 10.222.0.27 () {62 vars in 1319 bytes} [Fri Aug 5 07:18:40 2022] POST /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:18:41.098959 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7e7c506e-f6c2-40bc-8e7a-f064893fdd20 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:41.099672 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7e7c506e-f6c2-40bc-8e7a-f064893fdd20 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:41.105952 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7e7c506e-f6c2-40bc-8e7a-f064893fdd20 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:41.106441 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7e7c506e-f6c2-40bc-8e7a-f064893fdd20 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:41.106872 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7e7c506e-f6c2-40bc-8e7a-f064893fdd20 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:41.107580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7e7c506e-f6c2-40bc-8e7a-f064893fdd20 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:41.108050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7e7c506e-f6c2-40bc-8e7a-f064893fdd20 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:41.108490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7e7c506e-f6c2-40bc-8e7a-f064893fdd20 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:41.259599 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7e7c506e-f6c2-40bc-8e7a-f064893fdd20 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:41.269070 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7e7c506e-f6c2-40bc-8e7a-f064893fdd20 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:41.270647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7e7c506e-f6c2-40bc-8e7a-f064893fdd20 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:41.272213 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7e7c506e-f6c2-40bc-8e7a-f064893fdd20 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1750 microversion: 2.20 time: 0.177284 Aug 05 07:18:41.272847 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 235/460] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:41 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:41.976346 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-50ce0573-e652-42e7-8f4f-f9ad78700bbb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:41.977429 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-50ce0573-e652-42e7-8f4f-f9ad78700bbb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:41.988852 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-50ce0573-e652-42e7-8f4f-f9ad78700bbb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:41.989730 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-50ce0573-e652-42e7-8f4f-f9ad78700bbb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:41.990643 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-50ce0573-e652-42e7-8f4f-f9ad78700bbb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:41.991836 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-50ce0573-e652-42e7-8f4f-f9ad78700bbb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:41.992498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-50ce0573-e652-42e7-8f4f-f9ad78700bbb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:41.993269 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-50ce0573-e652-42e7-8f4f-f9ad78700bbb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:42.159069 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-50ce0573-e652-42e7-8f4f-f9ad78700bbb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:42.169183 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-50ce0573-e652-42e7-8f4f-f9ad78700bbb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.201186 Aug 05 07:18:42.170251 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 226/461] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:41 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:42.299879 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f488291e-da8f-414b-9ce7-c2c97c52e54d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:42.300515 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f488291e-da8f-414b-9ce7-c2c97c52e54d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:42.308612 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f488291e-da8f-414b-9ce7-c2c97c52e54d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:42.309163 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f488291e-da8f-414b-9ce7-c2c97c52e54d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:42.309604 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f488291e-da8f-414b-9ce7-c2c97c52e54d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:42.310325 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f488291e-da8f-414b-9ce7-c2c97c52e54d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:42.310781 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f488291e-da8f-414b-9ce7-c2c97c52e54d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:42.311221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f488291e-da8f-414b-9ce7-c2c97c52e54d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:42.459352 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f488291e-da8f-414b-9ce7-c2c97c52e54d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:42.469312 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f488291e-da8f-414b-9ce7-c2c97c52e54d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:42.471313 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f488291e-da8f-414b-9ce7-c2c97c52e54d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:42.472739 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f488291e-da8f-414b-9ce7-c2c97c52e54d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1752 microversion: 2.20 time: 0.177774 Aug 05 07:18:42.473585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 236/462] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:42 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:43.198515 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-23319890-03bc-4fe2-8b0f-a82c42237098 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:43.199611 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-23319890-03bc-4fe2-8b0f-a82c42237098 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:43.203523 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:43.213819 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-23319890-03bc-4fe2-8b0f-a82c42237098 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:43.214713 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-23319890-03bc-4fe2-8b0f-a82c42237098 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:43.215381 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-23319890-03bc-4fe2-8b0f-a82c42237098 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:43.216581 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-23319890-03bc-4fe2-8b0f-a82c42237098 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:43.217270 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-23319890-03bc-4fe2-8b0f-a82c42237098 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:43.217827 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-23319890-03bc-4fe2-8b0f-a82c42237098 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:43.393576 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-23319890-03bc-4fe2-8b0f-a82c42237098 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:43.408543 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-23319890-03bc-4fe2-8b0f-a82c42237098 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.216635 Aug 05 07:18:43.409848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 227/463] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:43 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:43.502251 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-56e56b3d-ee75-43a0-ae46-eed9a1542cd6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:43.503483 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-56e56b3d-ee75-43a0-ae46-eed9a1542cd6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:43.511352 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-56e56b3d-ee75-43a0-ae46-eed9a1542cd6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:43.511975 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-56e56b3d-ee75-43a0-ae46-eed9a1542cd6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:43.512546 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-56e56b3d-ee75-43a0-ae46-eed9a1542cd6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:43.513403 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-56e56b3d-ee75-43a0-ae46-eed9a1542cd6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:43.513951 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-56e56b3d-ee75-43a0-ae46-eed9a1542cd6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:43.514567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-56e56b3d-ee75-43a0-ae46-eed9a1542cd6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:43.673989 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-56e56b3d-ee75-43a0-ae46-eed9a1542cd6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:43.683750 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-56e56b3d-ee75-43a0-ae46-eed9a1542cd6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:43.685429 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-56e56b3d-ee75-43a0-ae46-eed9a1542cd6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:43.686865 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-56e56b3d-ee75-43a0-ae46-eed9a1542cd6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.190670 Aug 05 07:18:43.687694 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 237/464] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:43 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:44.434113 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-86c84def-a348-4458-a54a-9a9c300dd8e8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:44.435060 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-86c84def-a348-4458-a54a-9a9c300dd8e8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:44.442688 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86c84def-a348-4458-a54a-9a9c300dd8e8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:44.443324 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86c84def-a348-4458-a54a-9a9c300dd8e8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:44.443893 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86c84def-a348-4458-a54a-9a9c300dd8e8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:44.444863 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86c84def-a348-4458-a54a-9a9c300dd8e8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:44.445629 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86c84def-a348-4458-a54a-9a9c300dd8e8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:44.446116 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86c84def-a348-4458-a54a-9a9c300dd8e8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:44.451678 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:44.628989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-86c84def-a348-4458-a54a-9a9c300dd8e8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:44.637863 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-86c84def-a348-4458-a54a-9a9c300dd8e8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.208142 Aug 05 07:18:44.638457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 228/465] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:44 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:44.711315 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d9947d6e-15ff-440b-937e-713cfe096a3a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:44.712086 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d9947d6e-15ff-440b-937e-713cfe096a3a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:44.719611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9947d6e-15ff-440b-937e-713cfe096a3a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:44.721054 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9947d6e-15ff-440b-937e-713cfe096a3a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:44.721874 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9947d6e-15ff-440b-937e-713cfe096a3a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:44.723012 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9947d6e-15ff-440b-937e-713cfe096a3a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:44.723804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9947d6e-15ff-440b-937e-713cfe096a3a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:44.724565 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9947d6e-15ff-440b-937e-713cfe096a3a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:44.910136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d9947d6e-15ff-440b-937e-713cfe096a3a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:44.921352 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d9947d6e-15ff-440b-937e-713cfe096a3a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:44.924150 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d9947d6e-15ff-440b-937e-713cfe096a3a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:44.934833 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d9947d6e-15ff-440b-937e-713cfe096a3a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.218961 Aug 05 07:18:44.935702 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 238/466] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:44 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:45.660053 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-00e0fd56-cd7d-4f65-929c-66f5f4ef1874 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:45.660635 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-00e0fd56-cd7d-4f65-929c-66f5f4ef1874 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:45.667584 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-00e0fd56-cd7d-4f65-929c-66f5f4ef1874 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:45.668097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-00e0fd56-cd7d-4f65-929c-66f5f4ef1874 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:45.668529 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-00e0fd56-cd7d-4f65-929c-66f5f4ef1874 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:45.669273 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-00e0fd56-cd7d-4f65-929c-66f5f4ef1874 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:45.669723 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-00e0fd56-cd7d-4f65-929c-66f5f4ef1874 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:45.670142 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-00e0fd56-cd7d-4f65-929c-66f5f4ef1874 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:45.856047 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-00e0fd56-cd7d-4f65-929c-66f5f4ef1874 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:45.869073 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-00e0fd56-cd7d-4f65-929c-66f5f4ef1874 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.212702 Aug 05 07:18:45.870133 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 229/467] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:45 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:45.971158 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2167634f-8df9-46b0-b1bd-6203cb8bf597 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:45.972181 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2167634f-8df9-46b0-b1bd-6203cb8bf597 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:45.980672 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2167634f-8df9-46b0-b1bd-6203cb8bf597 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:45.981496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2167634f-8df9-46b0-b1bd-6203cb8bf597 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:45.982001 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2167634f-8df9-46b0-b1bd-6203cb8bf597 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:45.983182 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2167634f-8df9-46b0-b1bd-6203cb8bf597 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:45.983917 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2167634f-8df9-46b0-b1bd-6203cb8bf597 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:45.984572 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2167634f-8df9-46b0-b1bd-6203cb8bf597 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:46.135502 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2167634f-8df9-46b0-b1bd-6203cb8bf597 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:46.145331 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2167634f-8df9-46b0-b1bd-6203cb8bf597 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:46.147262 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2167634f-8df9-46b0-b1bd-6203cb8bf597 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:46.148688 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2167634f-8df9-46b0-b1bd-6203cb8bf597 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.183636 Aug 05 07:18:46.149487 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 239/468] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:45 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:46.894593 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6fc05f16-ec29-404c-a2bc-cbffd213f8b0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:46.895301 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6fc05f16-ec29-404c-a2bc-cbffd213f8b0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:46.903725 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fc05f16-ec29-404c-a2bc-cbffd213f8b0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:46.911441 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fc05f16-ec29-404c-a2bc-cbffd213f8b0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:46.912711 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fc05f16-ec29-404c-a2bc-cbffd213f8b0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:46.912711 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fc05f16-ec29-404c-a2bc-cbffd213f8b0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:46.913219 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fc05f16-ec29-404c-a2bc-cbffd213f8b0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:46.913889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fc05f16-ec29-404c-a2bc-cbffd213f8b0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:47.107476 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6fc05f16-ec29-404c-a2bc-cbffd213f8b0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:47.117191 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6fc05f16-ec29-404c-a2bc-cbffd213f8b0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.226728 Aug 05 07:18:47.118392 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 230/469] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:46 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:18:47.174006 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4e00351a-249b-4b0b-b33e-21e44d1ad2dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:47.174687 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4e00351a-249b-4b0b-b33e-21e44d1ad2dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:47.182292 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e00351a-249b-4b0b-b33e-21e44d1ad2dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:47.182806 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e00351a-249b-4b0b-b33e-21e44d1ad2dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:47.183233 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e00351a-249b-4b0b-b33e-21e44d1ad2dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:47.183936 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e00351a-249b-4b0b-b33e-21e44d1ad2dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:47.184385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e00351a-249b-4b0b-b33e-21e44d1ad2dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:47.184826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e00351a-249b-4b0b-b33e-21e44d1ad2dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:47.370033 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4e00351a-249b-4b0b-b33e-21e44d1ad2dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:47.385866 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4e00351a-249b-4b0b-b33e-21e44d1ad2dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:47.388585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4e00351a-249b-4b0b-b33e-21e44d1ad2dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:47.390849 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4e00351a-249b-4b0b-b33e-21e44d1ad2dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.220572 Aug 05 07:18:47.391851 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 240/470] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:47 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:47.753546 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1d2ffcbd-7267-4f18-b6ae-34f004137fcf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:47.754068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1d2ffcbd-7267-4f18-b6ae-34f004137fcf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:47.761491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d2ffcbd-7267-4f18-b6ae-34f004137fcf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:47.762246 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d2ffcbd-7267-4f18-b6ae-34f004137fcf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:47.762780 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d2ffcbd-7267-4f18-b6ae-34f004137fcf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:47.763601 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d2ffcbd-7267-4f18-b6ae-34f004137fcf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:47.764240 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d2ffcbd-7267-4f18-b6ae-34f004137fcf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:47.764755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d2ffcbd-7267-4f18-b6ae-34f004137fcf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:47.923733 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-1d2ffcbd-7267-4f18-b6ae-34f004137fcf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lazy-loading 'services' on Instance uuid acf59ded-e598-4ac7-ba2e-9a3c2210d007 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:18:48.062122 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1d2ffcbd-7267-4f18-b6ae-34f004137fcf tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "DELETE /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/os-volume_attachments/2aa5110b-f035-4f97-a186-28dcf3726c54" status: 202 len: 0 microversion: 2.1 time: 0.312670 Aug 05 07:18:48.062737 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 231/471] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 5 07:18:47 2022] DELETE /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/os-volume_attachments/2aa5110b-f035-4f97-a186-28dcf3726c54 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 07:18:48.143003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ac10cad3-b873-4ec7-abca-b03e8ed39095 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:48.143996 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ac10cad3-b873-4ec7-abca-b03e8ed39095 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:48.152947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ac10cad3-b873-4ec7-abca-b03e8ed39095 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:48.153410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ac10cad3-b873-4ec7-abca-b03e8ed39095 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:48.153840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ac10cad3-b873-4ec7-abca-b03e8ed39095 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:48.154656 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ac10cad3-b873-4ec7-abca-b03e8ed39095 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:48.154981 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ac10cad3-b873-4ec7-abca-b03e8ed39095 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:48.155396 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ac10cad3-b873-4ec7-abca-b03e8ed39095 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:48.317438 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ac10cad3-b873-4ec7-abca-b03e8ed39095 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:48.350504 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ac10cad3-b873-4ec7-abca-b03e8ed39095 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.213785 Aug 05 07:18:48.351512 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 241/472] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:48 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:48.426189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8ed97d9a-4d0e-48c5-b4cb-076cf047eefd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:48.426893 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8ed97d9a-4d0e-48c5-b4cb-076cf047eefd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:48.433651 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ed97d9a-4d0e-48c5-b4cb-076cf047eefd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:48.434135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ed97d9a-4d0e-48c5-b4cb-076cf047eefd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:48.434563 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ed97d9a-4d0e-48c5-b4cb-076cf047eefd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:48.435273 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ed97d9a-4d0e-48c5-b4cb-076cf047eefd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:48.435719 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ed97d9a-4d0e-48c5-b4cb-076cf047eefd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:48.436138 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ed97d9a-4d0e-48c5-b4cb-076cf047eefd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:48.608603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8ed97d9a-4d0e-48c5-b4cb-076cf047eefd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:48.618052 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8ed97d9a-4d0e-48c5-b4cb-076cf047eefd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:48.619623 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8ed97d9a-4d0e-48c5-b4cb-076cf047eefd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:48.620860 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8ed97d9a-4d0e-48c5-b4cb-076cf047eefd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.199849 Aug 05 07:18:48.621716 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 232/473] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:48 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:49.383475 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b0bc618a-db90-41bf-a039-7ffbd1d43117 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:49.384245 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b0bc618a-db90-41bf-a039-7ffbd1d43117 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:49.386994 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=50 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:49.393333 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b0bc618a-db90-41bf-a039-7ffbd1d43117 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:49.393882 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b0bc618a-db90-41bf-a039-7ffbd1d43117 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:49.394501 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b0bc618a-db90-41bf-a039-7ffbd1d43117 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:49.395279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b0bc618a-db90-41bf-a039-7ffbd1d43117 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:49.396158 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b0bc618a-db90-41bf-a039-7ffbd1d43117 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:49.396632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b0bc618a-db90-41bf-a039-7ffbd1d43117 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:49.564357 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b0bc618a-db90-41bf-a039-7ffbd1d43117 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:49.579609 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b0bc618a-db90-41bf-a039-7ffbd1d43117 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.200049 Aug 05 07:18:49.581534 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 242/474] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:49 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:49.649131 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a3665a25-7421-48e3-988a-a6502d02dab6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:49.650186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a3665a25-7421-48e3-988a-a6502d02dab6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:49.662397 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3665a25-7421-48e3-988a-a6502d02dab6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:49.663627 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3665a25-7421-48e3-988a-a6502d02dab6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:49.664635 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3665a25-7421-48e3-988a-a6502d02dab6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:49.666192 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3665a25-7421-48e3-988a-a6502d02dab6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:49.667267 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3665a25-7421-48e3-988a-a6502d02dab6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:49.668226 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3665a25-7421-48e3-988a-a6502d02dab6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:49.946443 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a3665a25-7421-48e3-988a-a6502d02dab6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:49.965368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a3665a25-7421-48e3-988a-a6502d02dab6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:49.967628 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a3665a25-7421-48e3-988a-a6502d02dab6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:49.969033 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a3665a25-7421-48e3-988a-a6502d02dab6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.327803 Aug 05 07:18:49.969677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 233/475] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:49 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:50.618622 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0778d241-bd97-46d4-98a0-9da990eca4a2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:50.619769 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0778d241-bd97-46d4-98a0-9da990eca4a2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:50.632240 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0778d241-bd97-46d4-98a0-9da990eca4a2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:50.633128 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0778d241-bd97-46d4-98a0-9da990eca4a2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:50.633886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0778d241-bd97-46d4-98a0-9da990eca4a2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:50.635110 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0778d241-bd97-46d4-98a0-9da990eca4a2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:50.635856 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0778d241-bd97-46d4-98a0-9da990eca4a2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:50.636592 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0778d241-bd97-46d4-98a0-9da990eca4a2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:50.925413 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0778d241-bd97-46d4-98a0-9da990eca4a2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:50.939588 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0778d241-bd97-46d4-98a0-9da990eca4a2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.329367 Aug 05 07:18:50.940586 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 243/476] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:50 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:18:50.996395 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0e8a9813-57b7-417e-ab1c-9754dd7193ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:50.997429 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0e8a9813-57b7-417e-ab1c-9754dd7193ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:51.004980 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0e8a9813-57b7-417e-ab1c-9754dd7193ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:51.005887 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0e8a9813-57b7-417e-ab1c-9754dd7193ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:51.006284 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0e8a9813-57b7-417e-ab1c-9754dd7193ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:51.007010 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0e8a9813-57b7-417e-ab1c-9754dd7193ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:51.007464 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0e8a9813-57b7-417e-ab1c-9754dd7193ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:51.007883 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0e8a9813-57b7-417e-ab1c-9754dd7193ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:51.217092 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0e8a9813-57b7-417e-ab1c-9754dd7193ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:51.232528 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0e8a9813-57b7-417e-ab1c-9754dd7193ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:51.234890 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0e8a9813-57b7-417e-ab1c-9754dd7193ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:51.236440 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0e8a9813-57b7-417e-ab1c-9754dd7193ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.244955 Aug 05 07:18:51.237231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 234/477] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:50 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:18:51.976234 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-45a758e6-396a-41a5-aa4f-397cd6177392 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:51.977552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-45a758e6-396a-41a5-aa4f-397cd6177392 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:51.989761 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45a758e6-396a-41a5-aa4f-397cd6177392 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:51.990871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45a758e6-396a-41a5-aa4f-397cd6177392 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:51.991780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45a758e6-396a-41a5-aa4f-397cd6177392 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:51.993152 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45a758e6-396a-41a5-aa4f-397cd6177392 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:51.993970 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45a758e6-396a-41a5-aa4f-397cd6177392 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:51.994865 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45a758e6-396a-41a5-aa4f-397cd6177392 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:52.210861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-45a758e6-396a-41a5-aa4f-397cd6177392 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:52.220628 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-45a758e6-396a-41a5-aa4f-397cd6177392 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.252202 Aug 05 07:18:52.221267 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 244/478] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:51 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:52.278328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f16b4f61-37f4-47c3-a67d-12f2da9f5451 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:52.279348 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f16b4f61-37f4-47c3-a67d-12f2da9f5451 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:52.287428 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f16b4f61-37f4-47c3-a67d-12f2da9f5451 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:52.287906 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f16b4f61-37f4-47c3-a67d-12f2da9f5451 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:52.288322 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f16b4f61-37f4-47c3-a67d-12f2da9f5451 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:52.289232 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f16b4f61-37f4-47c3-a67d-12f2da9f5451 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:52.289674 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f16b4f61-37f4-47c3-a67d-12f2da9f5451 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:52.290087 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f16b4f61-37f4-47c3-a67d-12f2da9f5451 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:52.487410 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f16b4f61-37f4-47c3-a67d-12f2da9f5451 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:52.498880 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f16b4f61-37f4-47c3-a67d-12f2da9f5451 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:52.501052 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f16b4f61-37f4-47c3-a67d-12f2da9f5451 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:52.503082 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f16b4f61-37f4-47c3-a67d-12f2da9f5451 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.229737 Aug 05 07:18:52.504288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 235/479] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:52 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:18:53.244392 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6ac309b3-1cd3-417f-bede-0cf874027e3a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:53.245867 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-6ac309b3-1cd3-417f-bede-0cf874027e3a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:53.255911 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6ac309b3-1cd3-417f-bede-0cf874027e3a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:53.256867 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6ac309b3-1cd3-417f-bede-0cf874027e3a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:53.257653 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6ac309b3-1cd3-417f-bede-0cf874027e3a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:53.259154 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6ac309b3-1cd3-417f-bede-0cf874027e3a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:53.260196 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6ac309b3-1cd3-417f-bede-0cf874027e3a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:53.261190 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6ac309b3-1cd3-417f-bede-0cf874027e3a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:53.269616 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:53.465923 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-6ac309b3-1cd3-417f-bede-0cf874027e3a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:53.475754 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-6ac309b3-1cd3-417f-bede-0cf874027e3a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.236356 Aug 05 07:18:53.476356 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 245/480] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:53 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:53.544048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-819e842b-571d-46a0-8a4c-0cfd74554c9b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:53.545010 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-819e842b-571d-46a0-8a4c-0cfd74554c9b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:53.556572 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-819e842b-571d-46a0-8a4c-0cfd74554c9b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:53.557475 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-819e842b-571d-46a0-8a4c-0cfd74554c9b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:53.558335 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-819e842b-571d-46a0-8a4c-0cfd74554c9b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:53.559531 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-819e842b-571d-46a0-8a4c-0cfd74554c9b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:53.560327 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-819e842b-571d-46a0-8a4c-0cfd74554c9b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:53.562587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-819e842b-571d-46a0-8a4c-0cfd74554c9b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:53.731426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-819e842b-571d-46a0-8a4c-0cfd74554c9b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:53.741094 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-819e842b-571d-46a0-8a4c-0cfd74554c9b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:53.742746 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-819e842b-571d-46a0-8a4c-0cfd74554c9b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:53.744079 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-819e842b-571d-46a0-8a4c-0cfd74554c9b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.204739 Aug 05 07:18:53.744672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 236/481] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:53 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:54.499426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7ff96b08-cb7c-4e8e-8677-717035e01f40 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:54.500037 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7ff96b08-cb7c-4e8e-8677-717035e01f40 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:54.507246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7ff96b08-cb7c-4e8e-8677-717035e01f40 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:54.507731 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7ff96b08-cb7c-4e8e-8677-717035e01f40 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:54.508158 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7ff96b08-cb7c-4e8e-8677-717035e01f40 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:54.509287 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7ff96b08-cb7c-4e8e-8677-717035e01f40 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:54.509733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7ff96b08-cb7c-4e8e-8677-717035e01f40 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:54.510152 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7ff96b08-cb7c-4e8e-8677-717035e01f40 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:54.768395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7ff96b08-cb7c-4e8e-8677-717035e01f40 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:54.771324 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-496ba022-dd89-484c-8626-bc6a4d7b4c93 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:54.773184 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-496ba022-dd89-484c-8626-bc6a4d7b4c93 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:54.781890 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-496ba022-dd89-484c-8626-bc6a4d7b4c93 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:54.782856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-496ba022-dd89-484c-8626-bc6a4d7b4c93 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:54.784480 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-496ba022-dd89-484c-8626-bc6a4d7b4c93 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:54.786027 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-496ba022-dd89-484c-8626-bc6a4d7b4c93 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:54.786771 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-496ba022-dd89-484c-8626-bc6a4d7b4c93 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:54.789162 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-496ba022-dd89-484c-8626-bc6a4d7b4c93 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:54.796384 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7ff96b08-cb7c-4e8e-8677-717035e01f40 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.300779 Aug 05 07:18:54.797213 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 246/482] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:54 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:55.026889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-496ba022-dd89-484c-8626-bc6a4d7b4c93 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:55.036755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-496ba022-dd89-484c-8626-bc6a4d7b4c93 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:55.038484 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-496ba022-dd89-484c-8626-bc6a4d7b4c93 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:55.039714 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-496ba022-dd89-484c-8626-bc6a4d7b4c93 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.275024 Aug 05 07:18:55.040467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 237/483] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:54 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:55.824330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-221bf440-c6c9-40e5-a9fc-49fb05fd1474 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:55.825564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-221bf440-c6c9-40e5-a9fc-49fb05fd1474 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:55.837715 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-221bf440-c6c9-40e5-a9fc-49fb05fd1474 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:55.838931 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-221bf440-c6c9-40e5-a9fc-49fb05fd1474 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:55.839968 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-221bf440-c6c9-40e5-a9fc-49fb05fd1474 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:55.841703 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-221bf440-c6c9-40e5-a9fc-49fb05fd1474 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:55.842505 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-221bf440-c6c9-40e5-a9fc-49fb05fd1474 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:55.843514 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-221bf440-c6c9-40e5-a9fc-49fb05fd1474 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:56.003033 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-221bf440-c6c9-40e5-a9fc-49fb05fd1474 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:56.012941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-221bf440-c6c9-40e5-a9fc-49fb05fd1474 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.196125 Aug 05 07:18:56.013815 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 247/484] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:55 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:56.065471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-db406e96-2926-4246-ab07-76d883124b8d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:56.066713 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-db406e96-2926-4246-ab07-76d883124b8d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:56.078619 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db406e96-2926-4246-ab07-76d883124b8d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:56.079544 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db406e96-2926-4246-ab07-76d883124b8d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:56.080352 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db406e96-2926-4246-ab07-76d883124b8d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:56.081692 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db406e96-2926-4246-ab07-76d883124b8d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:56.082546 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db406e96-2926-4246-ab07-76d883124b8d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:56.083331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db406e96-2926-4246-ab07-76d883124b8d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:56.495989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-db406e96-2926-4246-ab07-76d883124b8d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:56.507925 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-db406e96-2926-4246-ab07-76d883124b8d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:56.509684 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-db406e96-2926-4246-ab07-76d883124b8d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:56.510914 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-db406e96-2926-4246-ab07-76d883124b8d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.450689 Aug 05 07:18:56.511499 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 238/485] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:56 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:18:57.036234 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-567c79d2-14c9-42eb-b6b2-ca11eb035278 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:57.037057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-567c79d2-14c9-42eb-b6b2-ca11eb035278 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:57.044593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-567c79d2-14c9-42eb-b6b2-ca11eb035278 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:57.045107 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-567c79d2-14c9-42eb-b6b2-ca11eb035278 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:57.045649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-567c79d2-14c9-42eb-b6b2-ca11eb035278 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:57.046436 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-567c79d2-14c9-42eb-b6b2-ca11eb035278 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:57.046997 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-567c79d2-14c9-42eb-b6b2-ca11eb035278 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:57.047542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-567c79d2-14c9-42eb-b6b2-ca11eb035278 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:57.215581 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-567c79d2-14c9-42eb-b6b2-ca11eb035278 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:57.224688 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-567c79d2-14c9-42eb-b6b2-ca11eb035278 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.192649 Aug 05 07:18:57.225317 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 248/486] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:57 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:57.538252 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-43ffd488-c184-4ec8-98b0-a7bd256ee23e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:57.538948 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-43ffd488-c184-4ec8-98b0-a7bd256ee23e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:57.546705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-43ffd488-c184-4ec8-98b0-a7bd256ee23e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:57.547231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-43ffd488-c184-4ec8-98b0-a7bd256ee23e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:57.547644 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-43ffd488-c184-4ec8-98b0-a7bd256ee23e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:57.548373 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-43ffd488-c184-4ec8-98b0-a7bd256ee23e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:57.548833 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-43ffd488-c184-4ec8-98b0-a7bd256ee23e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:57.549297 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-43ffd488-c184-4ec8-98b0-a7bd256ee23e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:57.702672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-43ffd488-c184-4ec8-98b0-a7bd256ee23e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:57.712259 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-43ffd488-c184-4ec8-98b0-a7bd256ee23e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:57.714194 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-43ffd488-c184-4ec8-98b0-a7bd256ee23e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:57.715617 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-43ffd488-c184-4ec8-98b0-a7bd256ee23e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.181520 Aug 05 07:18:57.716333 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 239/487] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:57 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:57.718547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 07:18:57.718811 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Fri Aug 5 07:18:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 07:18:58.257482 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-25825471-a625-41bf-8992-968b2261a973 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:58.258564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-25825471-a625-41bf-8992-968b2261a973 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:58.268943 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-25825471-a625-41bf-8992-968b2261a973 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:58.269478 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-25825471-a625-41bf-8992-968b2261a973 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:58.269930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-25825471-a625-41bf-8992-968b2261a973 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:58.271063 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-25825471-a625-41bf-8992-968b2261a973 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:58.271510 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-25825471-a625-41bf-8992-968b2261a973 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:58.271964 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-25825471-a625-41bf-8992-968b2261a973 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:58.424010 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-25825471-a625-41bf-8992-968b2261a973 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:58.433440 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-25825471-a625-41bf-8992-968b2261a973 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.180011 Aug 05 07:18:58.434104 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 249/488] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:58 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:18:58.745218 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8e553143-0b8b-4296-b82e-586d36a18523 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:58.746065 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8e553143-0b8b-4296-b82e-586d36a18523 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:58.753498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8e553143-0b8b-4296-b82e-586d36a18523 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:58.754105 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8e553143-0b8b-4296-b82e-586d36a18523 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:58.754758 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8e553143-0b8b-4296-b82e-586d36a18523 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:58.755650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8e553143-0b8b-4296-b82e-586d36a18523 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:58.756150 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8e553143-0b8b-4296-b82e-586d36a18523 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:58.756583 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8e553143-0b8b-4296-b82e-586d36a18523 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:58.958317 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8e553143-0b8b-4296-b82e-586d36a18523 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:58.969680 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8e553143-0b8b-4296-b82e-586d36a18523 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:58.972379 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8e553143-0b8b-4296-b82e-586d36a18523 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:58.974129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8e553143-0b8b-4296-b82e-586d36a18523 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.233006 Aug 05 07:18:58.975025 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 240/489] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:18:58 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:18:59.455757 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-50321d12-ffa7-4ac2-95bd-8ac37a156240 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:18:59.456397 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-50321d12-ffa7-4ac2-95bd-8ac37a156240 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:18:59.463694 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-50321d12-ffa7-4ac2-95bd-8ac37a156240 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:59.464195 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-50321d12-ffa7-4ac2-95bd-8ac37a156240 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:59.464634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-50321d12-ffa7-4ac2-95bd-8ac37a156240 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:59.465388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-50321d12-ffa7-4ac2-95bd-8ac37a156240 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:18:59.465882 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-50321d12-ffa7-4ac2-95bd-8ac37a156240 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:18:59.466317 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-50321d12-ffa7-4ac2-95bd-8ac37a156240 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:18:59.627696 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-50321d12-ffa7-4ac2-95bd-8ac37a156240 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:18:59.637335 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-50321d12-ffa7-4ac2-95bd-8ac37a156240 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.185624 Aug 05 07:18:59.638114 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 250/490] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:18:59 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:00.012061 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1edc4e1c-92e0-4028-96d5-838a062b1d85 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:00.012866 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1edc4e1c-92e0-4028-96d5-838a062b1d85 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:00.020080 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1edc4e1c-92e0-4028-96d5-838a062b1d85 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:00.020926 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1edc4e1c-92e0-4028-96d5-838a062b1d85 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:00.021394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1edc4e1c-92e0-4028-96d5-838a062b1d85 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:00.022250 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1edc4e1c-92e0-4028-96d5-838a062b1d85 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:00.022784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1edc4e1c-92e0-4028-96d5-838a062b1d85 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:00.023214 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1edc4e1c-92e0-4028-96d5-838a062b1d85 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:00.216009 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1edc4e1c-92e0-4028-96d5-838a062b1d85 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:00.225422 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1edc4e1c-92e0-4028-96d5-838a062b1d85 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:00.226954 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1edc4e1c-92e0-4028-96d5-838a062b1d85 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:00.228171 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1edc4e1c-92e0-4028-96d5-838a062b1d85 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.220263 Aug 05 07:19:00.228767 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 241/491] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:00 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:00.659736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a37446a7-7565-4661-9bd3-fd33faa651b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:00.660386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a37446a7-7565-4661-9bd3-fd33faa651b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:00.667804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a37446a7-7565-4661-9bd3-fd33faa651b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:00.668291 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a37446a7-7565-4661-9bd3-fd33faa651b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:00.668719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a37446a7-7565-4661-9bd3-fd33faa651b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:00.669480 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a37446a7-7565-4661-9bd3-fd33faa651b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:00.669929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a37446a7-7565-4661-9bd3-fd33faa651b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:00.670351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a37446a7-7565-4661-9bd3-fd33faa651b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:00.869169 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a37446a7-7565-4661-9bd3-fd33faa651b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:00.878111 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a37446a7-7565-4661-9bd3-fd33faa651b6 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.222249 Aug 05 07:19:00.878717 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 251/492] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:00 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:01.259375 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d0b6be59-d1bc-4ae4-8e12-07f71dd7b4f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:01.260290 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d0b6be59-d1bc-4ae4-8e12-07f71dd7b4f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:01.267577 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0b6be59-d1bc-4ae4-8e12-07f71dd7b4f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:01.268124 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0b6be59-d1bc-4ae4-8e12-07f71dd7b4f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:01.268602 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0b6be59-d1bc-4ae4-8e12-07f71dd7b4f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:01.269438 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0b6be59-d1bc-4ae4-8e12-07f71dd7b4f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:01.269936 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0b6be59-d1bc-4ae4-8e12-07f71dd7b4f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:01.270887 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0b6be59-d1bc-4ae4-8e12-07f71dd7b4f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:01.427944 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d0b6be59-d1bc-4ae4-8e12-07f71dd7b4f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:01.442975 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d0b6be59-d1bc-4ae4-8e12-07f71dd7b4f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:01.446145 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d0b6be59-d1bc-4ae4-8e12-07f71dd7b4f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:01.448533 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d0b6be59-d1bc-4ae4-8e12-07f71dd7b4f8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.193431 Aug 05 07:19:01.449558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 242/493] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:01 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:01.907175 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-637587cc-c45c-41d9-951e-471a65fdb37a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:01.909504 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-637587cc-c45c-41d9-951e-471a65fdb37a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:01.921880 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-637587cc-c45c-41d9-951e-471a65fdb37a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:01.922733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-637587cc-c45c-41d9-951e-471a65fdb37a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:01.923480 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-637587cc-c45c-41d9-951e-471a65fdb37a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:01.924756 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-637587cc-c45c-41d9-951e-471a65fdb37a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:01.925614 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-637587cc-c45c-41d9-951e-471a65fdb37a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:01.926383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-637587cc-c45c-41d9-951e-471a65fdb37a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:02.163057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-637587cc-c45c-41d9-951e-471a65fdb37a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:02.181155 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-637587cc-c45c-41d9-951e-471a65fdb37a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.283392 Aug 05 07:19:02.182254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 252/494] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:01 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:02.474065 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-709d9dc5-64ea-467f-b2d1-fd73fc8dabe5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:02.475083 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-709d9dc5-64ea-467f-b2d1-fd73fc8dabe5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:02.485952 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-709d9dc5-64ea-467f-b2d1-fd73fc8dabe5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:02.486877 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-709d9dc5-64ea-467f-b2d1-fd73fc8dabe5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:02.487661 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-709d9dc5-64ea-467f-b2d1-fd73fc8dabe5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:02.489109 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-709d9dc5-64ea-467f-b2d1-fd73fc8dabe5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:02.489969 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-709d9dc5-64ea-467f-b2d1-fd73fc8dabe5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:02.490777 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-709d9dc5-64ea-467f-b2d1-fd73fc8dabe5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:02.655353 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-709d9dc5-64ea-467f-b2d1-fd73fc8dabe5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:02.664611 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-709d9dc5-64ea-467f-b2d1-fd73fc8dabe5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:02.666213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-709d9dc5-64ea-467f-b2d1-fd73fc8dabe5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:02.667443 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-709d9dc5-64ea-467f-b2d1-fd73fc8dabe5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.199290 Aug 05 07:19:02.668286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 243/495] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:02 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:03.213699 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6ff33b36-4a9f-4334-869b-96e6442ae1fa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:03.214419 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-6ff33b36-4a9f-4334-869b-96e6442ae1fa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:03.221898 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6ff33b36-4a9f-4334-869b-96e6442ae1fa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:03.222372 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6ff33b36-4a9f-4334-869b-96e6442ae1fa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:03.222805 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6ff33b36-4a9f-4334-869b-96e6442ae1fa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:03.223523 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6ff33b36-4a9f-4334-869b-96e6442ae1fa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:03.223978 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6ff33b36-4a9f-4334-869b-96e6442ae1fa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:03.224414 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6ff33b36-4a9f-4334-869b-96e6442ae1fa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:03.394605 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-6ff33b36-4a9f-4334-869b-96e6442ae1fa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:03.404682 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-6ff33b36-4a9f-4334-869b-96e6442ae1fa tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.195064 Aug 05 07:19:03.405316 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 253/496] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:03 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:03.707121 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bd672f77-3202-4528-a26a-c63dfe5c978e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:03.707815 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bd672f77-3202-4528-a26a-c63dfe5c978e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:03.715328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd672f77-3202-4528-a26a-c63dfe5c978e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:03.715825 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd672f77-3202-4528-a26a-c63dfe5c978e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:03.716263 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd672f77-3202-4528-a26a-c63dfe5c978e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:03.717026 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd672f77-3202-4528-a26a-c63dfe5c978e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:03.717468 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd672f77-3202-4528-a26a-c63dfe5c978e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:03.717995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd672f77-3202-4528-a26a-c63dfe5c978e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:03.722990 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:03.870639 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bd672f77-3202-4528-a26a-c63dfe5c978e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:03.881483 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bd672f77-3202-4528-a26a-c63dfe5c978e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:03.883004 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bd672f77-3202-4528-a26a-c63dfe5c978e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:03.884232 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bd672f77-3202-4528-a26a-c63dfe5c978e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.181220 Aug 05 07:19:03.884844 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 244/497] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:03 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:04.426884 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-87cd3a60-e9f6-4227-a23a-0304c039c115 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:04.427486 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-87cd3a60-e9f6-4227-a23a-0304c039c115 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:04.435219 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-87cd3a60-e9f6-4227-a23a-0304c039c115 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:04.435762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-87cd3a60-e9f6-4227-a23a-0304c039c115 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:04.436248 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-87cd3a60-e9f6-4227-a23a-0304c039c115 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:04.437067 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-87cd3a60-e9f6-4227-a23a-0304c039c115 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:04.437566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-87cd3a60-e9f6-4227-a23a-0304c039c115 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:04.438069 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-87cd3a60-e9f6-4227-a23a-0304c039c115 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:04.583683 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-87cd3a60-e9f6-4227-a23a-0304c039c115 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:04.596229 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-87cd3a60-e9f6-4227-a23a-0304c039c115 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.173076 Aug 05 07:19:04.597047 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 254/498] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:04 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:04.910811 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ac00438e-ae98-4faa-8624-6c7b31f5ae84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:04.911817 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ac00438e-ae98-4faa-8624-6c7b31f5ae84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:04.919752 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac00438e-ae98-4faa-8624-6c7b31f5ae84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:04.920226 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac00438e-ae98-4faa-8624-6c7b31f5ae84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:04.920703 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac00438e-ae98-4faa-8624-6c7b31f5ae84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:04.921542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac00438e-ae98-4faa-8624-6c7b31f5ae84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:04.922008 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac00438e-ae98-4faa-8624-6c7b31f5ae84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:04.922460 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac00438e-ae98-4faa-8624-6c7b31f5ae84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:05.074145 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ac00438e-ae98-4faa-8624-6c7b31f5ae84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:05.084168 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ac00438e-ae98-4faa-8624-6c7b31f5ae84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:05.085996 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ac00438e-ae98-4faa-8624-6c7b31f5ae84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:05.087278 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ac00438e-ae98-4faa-8624-6c7b31f5ae84 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.181790 Aug 05 07:19:05.087940 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 245/499] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:04 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:05.457515 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-26bf46ed-7d54-41c0-a6a9-b1172636cbdc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:19:05.465857 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26bf46ed-7d54-41c0-a6a9-b1172636cbdc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:05.466359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26bf46ed-7d54-41c0-a6a9-b1172636cbdc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:05.466796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26bf46ed-7d54-41c0-a6a9-b1172636cbdc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:05.494094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-26bf46ed-7d54-41c0-a6a9-b1172636cbdc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Going to try to stop instance {{(pid=117894) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 07:19:05.546657 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-26bf46ed-7d54-41c0-a6a9-b1172636cbdc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "POST /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/action" status: 202 len: 0 microversion: 2.1 time: 0.092924 Aug 05 07:19:05.547167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 255/500] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:19:05 2022] POST /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:19:05.557160 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1c6f8f34-eda1-47a2-95a2-8cb543e05624 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:05.557791 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1c6f8f34-eda1-47a2-95a2-8cb543e05624 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:05.565320 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1c6f8f34-eda1-47a2-95a2-8cb543e05624 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:05.565954 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1c6f8f34-eda1-47a2-95a2-8cb543e05624 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:05.566834 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1c6f8f34-eda1-47a2-95a2-8cb543e05624 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:05.568152 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1c6f8f34-eda1-47a2-95a2-8cb543e05624 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:05.569013 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1c6f8f34-eda1-47a2-95a2-8cb543e05624 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:05.569768 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1c6f8f34-eda1-47a2-95a2-8cb543e05624 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:05.621419 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-63466db2-d789-4a62-b374-4865bb289c19 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:05.622254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-63466db2-d789-4a62-b374-4865bb289c19 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:05.629673 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-63466db2-d789-4a62-b374-4865bb289c19 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:05.630161 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-63466db2-d789-4a62-b374-4865bb289c19 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:05.630623 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-63466db2-d789-4a62-b374-4865bb289c19 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:05.631366 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-63466db2-d789-4a62-b374-4865bb289c19 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:05.631835 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-63466db2-d789-4a62-b374-4865bb289c19 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:05.632271 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-63466db2-d789-4a62-b374-4865bb289c19 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:05.787009 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1c6f8f34-eda1-47a2-95a2-8cb543e05624 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:05.802048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1c6f8f34-eda1-47a2-95a2-8cb543e05624 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.248441 Aug 05 07:19:05.803221 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 246/501] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:05 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:05.836118 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-63466db2-d789-4a62-b374-4865bb289c19 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:05.845977 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-63466db2-d789-4a62-b374-4865bb289c19 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1737 microversion: 2.1 time: 0.229053 Aug 05 07:19:05.846600 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 256/502] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:05 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:19:06.111873 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b2779f3e-1012-4fe4-98f8-b7da264cfc3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:06.112483 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b2779f3e-1012-4fe4-98f8-b7da264cfc3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:06.120021 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2779f3e-1012-4fe4-98f8-b7da264cfc3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:06.120511 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2779f3e-1012-4fe4-98f8-b7da264cfc3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:06.120950 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2779f3e-1012-4fe4-98f8-b7da264cfc3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:06.121705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2779f3e-1012-4fe4-98f8-b7da264cfc3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:06.122161 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2779f3e-1012-4fe4-98f8-b7da264cfc3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:06.122583 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2779f3e-1012-4fe4-98f8-b7da264cfc3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:06.295564 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b2779f3e-1012-4fe4-98f8-b7da264cfc3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:06.308876 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b2779f3e-1012-4fe4-98f8-b7da264cfc3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:06.310816 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b2779f3e-1012-4fe4-98f8-b7da264cfc3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:06.312465 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b2779f3e-1012-4fe4-98f8-b7da264cfc3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.204785 Aug 05 07:19:06.325800 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 247/503] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:06 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:06.836375 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c8b5016e-4abf-4e1e-b9b7-d0b2d1d469e2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:06.837082 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c8b5016e-4abf-4e1e-b9b7-d0b2d1d469e2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:06.844582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8b5016e-4abf-4e1e-b9b7-d0b2d1d469e2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:06.845150 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8b5016e-4abf-4e1e-b9b7-d0b2d1d469e2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:06.845598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8b5016e-4abf-4e1e-b9b7-d0b2d1d469e2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:06.846331 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8b5016e-4abf-4e1e-b9b7-d0b2d1d469e2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:06.846792 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8b5016e-4abf-4e1e-b9b7-d0b2d1d469e2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:06.847226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8b5016e-4abf-4e1e-b9b7-d0b2d1d469e2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:06.871540 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-93031da7-5ad7-40f2-b2a7-b841e1c63f6c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:06.872507 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-93031da7-5ad7-40f2-b2a7-b841e1c63f6c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:06.883435 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-93031da7-5ad7-40f2-b2a7-b841e1c63f6c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:06.884284 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-93031da7-5ad7-40f2-b2a7-b841e1c63f6c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:06.885097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-93031da7-5ad7-40f2-b2a7-b841e1c63f6c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:06.886380 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-93031da7-5ad7-40f2-b2a7-b841e1c63f6c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:06.887270 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-93031da7-5ad7-40f2-b2a7-b841e1c63f6c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:06.887985 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-93031da7-5ad7-40f2-b2a7-b841e1c63f6c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:07.094193 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c8b5016e-4abf-4e1e-b9b7-d0b2d1d469e2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:07.106204 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c8b5016e-4abf-4e1e-b9b7-d0b2d1d469e2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.273626 Aug 05 07:19:07.107097 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 257/504] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:06 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:07.248110 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-93031da7-5ad7-40f2-b2a7-b841e1c63f6c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:07.264399 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-93031da7-5ad7-40f2-b2a7-b841e1c63f6c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1717 microversion: 2.1 time: 0.399312 Aug 05 07:19:07.265812 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 248/505] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:06 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1717 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:19:07.342934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a8cc752b-65fa-4970-9c05-80418f0ed62c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:07.343764 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a8cc752b-65fa-4970-9c05-80418f0ed62c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:07.344775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a6bbc0fe-a643-4c7d-a53b-d883e369dadb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:07.345315 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a6bbc0fe-a643-4c7d-a53b-d883e369dadb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:07.351981 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6bbc0fe-a643-4c7d-a53b-d883e369dadb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:07.352864 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6bbc0fe-a643-4c7d-a53b-d883e369dadb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:07.353345 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a8cc752b-65fa-4970-9c05-80418f0ed62c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:07.353920 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6bbc0fe-a643-4c7d-a53b-d883e369dadb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:07.354176 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a8cc752b-65fa-4970-9c05-80418f0ed62c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:07.354692 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6bbc0fe-a643-4c7d-a53b-d883e369dadb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:07.355079 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a8cc752b-65fa-4970-9c05-80418f0ed62c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:07.355271 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6bbc0fe-a643-4c7d-a53b-d883e369dadb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:07.355569 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6bbc0fe-a643-4c7d-a53b-d883e369dadb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:07.356099 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a8cc752b-65fa-4970-9c05-80418f0ed62c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:07.356785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a8cc752b-65fa-4970-9c05-80418f0ed62c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:07.357470 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a8cc752b-65fa-4970-9c05-80418f0ed62c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:07.460183 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-a6bbc0fe-a643-4c7d-a53b-d883e369dadb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] HTTP exception thrown: Cannot 'detach_volume' instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d while it is in vm_state rescued Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a6bbc0fe-a643-4c7d-a53b-d883e369dadb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Request method failure captured: Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments/7e0c3d1b-f220-4931-9b0f-8b2101b36aed HTTP/1.1 Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MM-EQUpnzTV_TuaBii4EnDtucJf3DBJQuckc_cz-EahkMlyKuaPdeRlNPw5xVtsl6C2UBh_Yoa08ue84u1Lxb6YzWInBS__DjPsZZfDUKm9pQ3Ro_hNX8NmosRUVx0DbFBQGMhI8X49NbxrPMBizm2j_rmdwFPmQfNSyM6KMFZP8bo Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: fe39edf907ff48518759474a800b949d Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:19:07.461965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:19:07.464770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe39edf907ff48518759474a800b949d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe39edf907ff48518759474a800b949d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe39edf907ff48518759474a800b949d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe39edf907ff48518759474a800b949d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:19:07.464770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:19:07.464770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: fe39edf907ff48518759474a800b949d Aug 05 07:19:07.464770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:19:07.464770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-ServerRescueNegativeTestJSON-619170576-project Aug 05 07:19:07.464770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:19:07.464770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:19:07.464770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 2ce8bf4f0ab64010b3855193f55971d2 Aug 05 07:19:07.464770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-ServerRescueNegativeTestJSON-619170576-project Aug 05 07:19:07.464770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:19:07.464770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Cannot 'detach_volume' instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d while it is in vm_state rescued Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'server_id': '93d20686-267a-4bf7-b36b-7a248b0c3d8d', 'id': '7e0c3d1b-f220-4931-9b0f-8b2101b36aed'} Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:19:07.466127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d while it is in vm_state rescued Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d while it is in vm_state rescued Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:07.468558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a6bbc0fe-a643-4c7d-a53b-d883e369dadb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Returning 409 to user: Cannot 'detach_volume' instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d while it is in vm_state rescued {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:19:07.470465 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a6bbc0fe-a643-4c7d-a53b-d883e369dadb tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments/7e0c3d1b-f220-4931-9b0f-8b2101b36aed" status: 409 len: 152 microversion: 2.1 time: 0.123175 Aug 05 07:19:07.470465 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 249/506] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 5 07:19:07 2022] DELETE /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments/7e0c3d1b-f220-4931-9b0f-8b2101b36aed => generated 152 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 05 07:19:07.475118 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-015f291f-f527-40a5-97a9-1bbddad0c7c9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:19:07.475661 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-015f291f-f527-40a5-97a9-1bbddad0c7c9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:07.483193 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-015f291f-f527-40a5-97a9-1bbddad0c7c9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:07.483791 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-015f291f-f527-40a5-97a9-1bbddad0c7c9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:07.484400 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-015f291f-f527-40a5-97a9-1bbddad0c7c9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:07.485381 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-015f291f-f527-40a5-97a9-1bbddad0c7c9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:07.485988 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-015f291f-f527-40a5-97a9-1bbddad0c7c9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:07.486502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-015f291f-f527-40a5-97a9-1bbddad0c7c9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:07.589297 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-015f291f-f527-40a5-97a9-1bbddad0c7c9 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "POST /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/action" status: 202 len: 0 microversion: 2.1 time: 0.117492 Aug 05 07:19:07.595305 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 250/507] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:19:07 2022] POST /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:19:07.604467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-255d993a-c2ae-45d1-bd03-882c345e2cf1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:07.605766 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-255d993a-c2ae-45d1-bd03-882c345e2cf1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:07.617560 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-255d993a-c2ae-45d1-bd03-882c345e2cf1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:07.618236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-255d993a-c2ae-45d1-bd03-882c345e2cf1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:07.618841 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-255d993a-c2ae-45d1-bd03-882c345e2cf1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:07.619835 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-255d993a-c2ae-45d1-bd03-882c345e2cf1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:07.620391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-255d993a-c2ae-45d1-bd03-882c345e2cf1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:07.620972 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-255d993a-c2ae-45d1-bd03-882c345e2cf1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:07.716521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a8cc752b-65fa-4970-9c05-80418f0ed62c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:07.737610 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a8cc752b-65fa-4970-9c05-80418f0ed62c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:07.742997 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a8cc752b-65fa-4970-9c05-80418f0ed62c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:07.745487 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a8cc752b-65fa-4970-9c05-80418f0ed62c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.409478 Aug 05 07:19:07.746520 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 258/508] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:07 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:19:07.823005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-255d993a-c2ae-45d1-bd03-882c345e2cf1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:07.836274 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-255d993a-c2ae-45d1-bd03-882c345e2cf1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1725 microversion: 2.1 time: 0.238122 Aug 05 07:19:07.837103 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 251/509] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:07 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:19:08.137690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5c77ccc4-a7b5-4bc5-8353-1244b3d33c11 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:08.138633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5c77ccc4-a7b5-4bc5-8353-1244b3d33c11 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:08.147631 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5c77ccc4-a7b5-4bc5-8353-1244b3d33c11 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:08.148243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5c77ccc4-a7b5-4bc5-8353-1244b3d33c11 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:08.148781 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5c77ccc4-a7b5-4bc5-8353-1244b3d33c11 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:08.149868 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5c77ccc4-a7b5-4bc5-8353-1244b3d33c11 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:08.150451 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5c77ccc4-a7b5-4bc5-8353-1244b3d33c11 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:08.150933 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5c77ccc4-a7b5-4bc5-8353-1244b3d33c11 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:08.448386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5c77ccc4-a7b5-4bc5-8353-1244b3d33c11 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:08.458320 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5c77ccc4-a7b5-4bc5-8353-1244b3d33c11 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.325391 Aug 05 07:19:08.459089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 259/510] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:08 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:08.773363 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8f2904fe-4de2-4808-8095-b25363244d5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:08.774040 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8f2904fe-4de2-4808-8095-b25363244d5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:08.781955 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8f2904fe-4de2-4808-8095-b25363244d5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:08.782445 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8f2904fe-4de2-4808-8095-b25363244d5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:08.782969 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8f2904fe-4de2-4808-8095-b25363244d5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:08.783681 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8f2904fe-4de2-4808-8095-b25363244d5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:08.784135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8f2904fe-4de2-4808-8095-b25363244d5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:08.784550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8f2904fe-4de2-4808-8095-b25363244d5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:08.864867 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a6ac3cfb-8c5e-4168-ba32-e58c5b67c071 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:08.866130 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a6ac3cfb-8c5e-4168-ba32-e58c5b67c071 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:08.878182 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a6ac3cfb-8c5e-4168-ba32-e58c5b67c071 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:08.879075 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a6ac3cfb-8c5e-4168-ba32-e58c5b67c071 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:08.880003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a6ac3cfb-8c5e-4168-ba32-e58c5b67c071 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:08.881345 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a6ac3cfb-8c5e-4168-ba32-e58c5b67c071 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:08.882200 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a6ac3cfb-8c5e-4168-ba32-e58c5b67c071 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:08.883097 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a6ac3cfb-8c5e-4168-ba32-e58c5b67c071 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:08.943442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8f2904fe-4de2-4808-8095-b25363244d5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:08.953323 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8f2904fe-4de2-4808-8095-b25363244d5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:08.954883 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8f2904fe-4de2-4808-8095-b25363244d5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:08.956167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8f2904fe-4de2-4808-8095-b25363244d5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.187593 Aug 05 07:19:08.956713 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 252/511] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:08 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:09.075115 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a6ac3cfb-8c5e-4168-ba32-e58c5b67c071 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:09.079967 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:09.087147 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a6ac3cfb-8c5e-4168-ba32-e58c5b67c071 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1725 microversion: 2.1 time: 0.229822 Aug 05 07:19:09.087747 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 260/512] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:08 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:09.480708 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d15e8df2-4fc8-4434-8570-33cb1fa731b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:09.481465 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d15e8df2-4fc8-4434-8570-33cb1fa731b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:09.488862 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d15e8df2-4fc8-4434-8570-33cb1fa731b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:09.489391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d15e8df2-4fc8-4434-8570-33cb1fa731b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:09.489829 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d15e8df2-4fc8-4434-8570-33cb1fa731b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:09.490549 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d15e8df2-4fc8-4434-8570-33cb1fa731b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:09.491002 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d15e8df2-4fc8-4434-8570-33cb1fa731b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:09.491453 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d15e8df2-4fc8-4434-8570-33cb1fa731b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:09.668665 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d15e8df2-4fc8-4434-8570-33cb1fa731b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:09.677164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d15e8df2-4fc8-4434-8570-33cb1fa731b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.200508 Aug 05 07:19:09.677778 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 253/513] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:09 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:09.981177 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-435ec56f-52fe-4b58-bd48-58547e741deb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:09.981920 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-435ec56f-52fe-4b58-bd48-58547e741deb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:09.990229 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-435ec56f-52fe-4b58-bd48-58547e741deb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:09.990728 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-435ec56f-52fe-4b58-bd48-58547e741deb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:09.991176 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-435ec56f-52fe-4b58-bd48-58547e741deb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:09.991908 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-435ec56f-52fe-4b58-bd48-58547e741deb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:09.992366 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-435ec56f-52fe-4b58-bd48-58547e741deb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:09.992791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-435ec56f-52fe-4b58-bd48-58547e741deb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:10.108725 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b26db139-3adb-4408-947a-58723e9f35c3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:10.109407 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b26db139-3adb-4408-947a-58723e9f35c3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:10.117430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b26db139-3adb-4408-947a-58723e9f35c3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:10.117883 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b26db139-3adb-4408-947a-58723e9f35c3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:10.118356 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b26db139-3adb-4408-947a-58723e9f35c3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:10.119117 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b26db139-3adb-4408-947a-58723e9f35c3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:10.119578 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b26db139-3adb-4408-947a-58723e9f35c3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:10.120011 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b26db139-3adb-4408-947a-58723e9f35c3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:10.180674 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-435ec56f-52fe-4b58-bd48-58547e741deb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:10.191020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-435ec56f-52fe-4b58-bd48-58547e741deb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:10.192730 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-435ec56f-52fe-4b58-bd48-58547e741deb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:10.194081 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-435ec56f-52fe-4b58-bd48-58547e741deb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.217588 Aug 05 07:19:10.194824 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 261/514] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:09 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:10.336944 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b26db139-3adb-4408-947a-58723e9f35c3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:10.346786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b26db139-3adb-4408-947a-58723e9f35c3 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1725 microversion: 2.1 time: 0.242370 Aug 05 07:19:10.347366 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 254/515] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:10 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:10.817226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-069d2b30-9bbc-448b-aac2-c7ef6bb1aa3d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:10.817852 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-069d2b30-9bbc-448b-aac2-c7ef6bb1aa3d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:10.827334 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-069d2b30-9bbc-448b-aac2-c7ef6bb1aa3d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:10.828262 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-069d2b30-9bbc-448b-aac2-c7ef6bb1aa3d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:10.829055 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-069d2b30-9bbc-448b-aac2-c7ef6bb1aa3d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:10.830369 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-069d2b30-9bbc-448b-aac2-c7ef6bb1aa3d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:10.831170 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-069d2b30-9bbc-448b-aac2-c7ef6bb1aa3d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:10.832002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-069d2b30-9bbc-448b-aac2-c7ef6bb1aa3d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:11.019382 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-069d2b30-9bbc-448b-aac2-c7ef6bb1aa3d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:11.029425 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-069d2b30-9bbc-448b-aac2-c7ef6bb1aa3d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.334232 Aug 05 07:19:11.030338 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 262/516] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:10 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:11.218593 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-894e610e-994d-4ff9-9839-449dd879cd6e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:11.219450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-894e610e-994d-4ff9-9839-449dd879cd6e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:11.226616 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-894e610e-994d-4ff9-9839-449dd879cd6e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:11.227102 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-894e610e-994d-4ff9-9839-449dd879cd6e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:11.227531 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-894e610e-994d-4ff9-9839-449dd879cd6e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:11.228258 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-894e610e-994d-4ff9-9839-449dd879cd6e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:11.228705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-894e610e-994d-4ff9-9839-449dd879cd6e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:11.229165 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-894e610e-994d-4ff9-9839-449dd879cd6e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:11.373932 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-18c0a857-439b-485c-afa8-e0346c5e16f4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:11.375093 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-18c0a857-439b-485c-afa8-e0346c5e16f4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:11.386734 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-18c0a857-439b-485c-afa8-e0346c5e16f4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:11.387614 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-18c0a857-439b-485c-afa8-e0346c5e16f4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:11.388382 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-18c0a857-439b-485c-afa8-e0346c5e16f4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:11.389901 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-18c0a857-439b-485c-afa8-e0346c5e16f4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:11.390768 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-18c0a857-439b-485c-afa8-e0346c5e16f4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:11.391640 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-18c0a857-439b-485c-afa8-e0346c5e16f4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:11.433824 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-894e610e-994d-4ff9-9839-449dd879cd6e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:11.444991 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-894e610e-994d-4ff9-9839-449dd879cd6e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:11.447797 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-894e610e-994d-4ff9-9839-449dd879cd6e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:11.449589 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-894e610e-994d-4ff9-9839-449dd879cd6e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.235326 Aug 05 07:19:11.450272 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 255/517] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:11 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:11.613196 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-18c0a857-439b-485c-afa8-e0346c5e16f4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:11.625496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-18c0a857-439b-485c-afa8-e0346c5e16f4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1725 microversion: 2.1 time: 0.259026 Aug 05 07:19:11.626102 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 263/518] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:11 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:12.051367 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-be58de0c-642f-4292-b3f9-493ad1581932 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:12.052053 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-be58de0c-642f-4292-b3f9-493ad1581932 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:12.059609 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be58de0c-642f-4292-b3f9-493ad1581932 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:12.060162 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be58de0c-642f-4292-b3f9-493ad1581932 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:12.060622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be58de0c-642f-4292-b3f9-493ad1581932 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:12.061597 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be58de0c-642f-4292-b3f9-493ad1581932 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:12.062190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be58de0c-642f-4292-b3f9-493ad1581932 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:12.062657 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be58de0c-642f-4292-b3f9-493ad1581932 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:12.219391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-be58de0c-642f-4292-b3f9-493ad1581932 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:12.230245 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-be58de0c-642f-4292-b3f9-493ad1581932 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.182944 Aug 05 07:19:12.231208 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 256/519] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:12 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:12.478170 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-965d9547-f430-453d-b5ce-39b7c9d806c8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:12.478901 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-965d9547-f430-453d-b5ce-39b7c9d806c8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:12.486712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-965d9547-f430-453d-b5ce-39b7c9d806c8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:12.487213 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-965d9547-f430-453d-b5ce-39b7c9d806c8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:12.487655 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-965d9547-f430-453d-b5ce-39b7c9d806c8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:12.488391 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-965d9547-f430-453d-b5ce-39b7c9d806c8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:12.488871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-965d9547-f430-453d-b5ce-39b7c9d806c8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:12.489338 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-965d9547-f430-453d-b5ce-39b7c9d806c8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:12.653841 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e58b4efd-3005-4e70-a066-64959921da32 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:12.655237 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e58b4efd-3005-4e70-a066-64959921da32 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:12.666432 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e58b4efd-3005-4e70-a066-64959921da32 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:12.667855 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e58b4efd-3005-4e70-a066-64959921da32 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:12.668948 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e58b4efd-3005-4e70-a066-64959921da32 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:12.670617 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e58b4efd-3005-4e70-a066-64959921da32 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:12.671757 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e58b4efd-3005-4e70-a066-64959921da32 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:12.672495 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e58b4efd-3005-4e70-a066-64959921da32 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:12.695385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-965d9547-f430-453d-b5ce-39b7c9d806c8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:12.709604 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-965d9547-f430-453d-b5ce-39b7c9d806c8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:12.712163 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-965d9547-f430-453d-b5ce-39b7c9d806c8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:12.713703 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-965d9547-f430-453d-b5ce-39b7c9d806c8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.239759 Aug 05 07:19:12.714777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 264/520] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:12 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:12.856496 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e58b4efd-3005-4e70-a066-64959921da32 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:12.865863 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e58b4efd-3005-4e70-a066-64959921da32 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1731 microversion: 2.1 time: 0.221113 Aug 05 07:19:12.866539 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 257/521] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:12 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:12.901566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d166b650-0104-4691-bf91-7c3977674bee tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:12.902138 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d166b650-0104-4691-bf91-7c3977674bee tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:12.910378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d166b650-0104-4691-bf91-7c3977674bee tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:12.911006 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d166b650-0104-4691-bf91-7c3977674bee tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:12.911725 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d166b650-0104-4691-bf91-7c3977674bee tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:12.912530 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d166b650-0104-4691-bf91-7c3977674bee tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:12.913088 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d166b650-0104-4691-bf91-7c3977674bee tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:12.913612 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d166b650-0104-4691-bf91-7c3977674bee tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:13.013402 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d166b650-0104-4691-bf91-7c3977674bee tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116726 Aug 05 07:19:13.014011 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 265/522] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 5 07:19:12 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:19:13.253960 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6e921e11-5f27-4371-8d62-ad79d84a1d6e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:13.254805 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6e921e11-5f27-4371-8d62-ad79d84a1d6e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:13.258672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=62 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:13.263296 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e921e11-5f27-4371-8d62-ad79d84a1d6e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:13.263982 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e921e11-5f27-4371-8d62-ad79d84a1d6e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:13.264325 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e921e11-5f27-4371-8d62-ad79d84a1d6e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:13.265240 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e921e11-5f27-4371-8d62-ad79d84a1d6e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:13.265687 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e921e11-5f27-4371-8d62-ad79d84a1d6e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:13.266104 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e921e11-5f27-4371-8d62-ad79d84a1d6e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:13.477091 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6e921e11-5f27-4371-8d62-ad79d84a1d6e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:13.486358 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6e921e11-5f27-4371-8d62-ad79d84a1d6e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.236671 Aug 05 07:19:13.487394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 258/523] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:13 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:13.747099 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-316c4cba-e944-4c65-a6db-ea25424fd1ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:13.748242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-316c4cba-e944-4c65-a6db-ea25424fd1ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:13.759787 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-316c4cba-e944-4c65-a6db-ea25424fd1ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:13.760706 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-316c4cba-e944-4c65-a6db-ea25424fd1ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:13.761552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-316c4cba-e944-4c65-a6db-ea25424fd1ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:13.762819 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-316c4cba-e944-4c65-a6db-ea25424fd1ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:13.763449 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-316c4cba-e944-4c65-a6db-ea25424fd1ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:13.764256 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-316c4cba-e944-4c65-a6db-ea25424fd1ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:14.036498 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-316c4cba-e944-4c65-a6db-ea25424fd1ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:14.052832 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-316c4cba-e944-4c65-a6db-ea25424fd1ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:14.056929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-316c4cba-e944-4c65-a6db-ea25424fd1ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:14.071094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-316c4cba-e944-4c65-a6db-ea25424fd1ae tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.333424 Aug 05 07:19:14.072525 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 266/524] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:13 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:14.512637 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e2d6fde3-e413-43b6-9d61-49d968c93475 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:14.513534 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e2d6fde3-e413-43b6-9d61-49d968c93475 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:14.524266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d6fde3-e413-43b6-9d61-49d968c93475 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:14.524877 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d6fde3-e413-43b6-9d61-49d968c93475 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:14.525698 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d6fde3-e413-43b6-9d61-49d968c93475 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:14.527235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d6fde3-e413-43b6-9d61-49d968c93475 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:14.527712 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d6fde3-e413-43b6-9d61-49d968c93475 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:14.528141 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d6fde3-e413-43b6-9d61-49d968c93475 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:14.555662 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-8cc5b2c7-67db-4c9f-a7b2-4f52e0270e08 req-4cbff0bd-259c-44b3-8ccd-505c829ba254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d20686-267a-4bf7-b36b-7a248b0c3d8d", "tag": "08518c24-70ef-4c17-a240-418e5eae2128"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:19:14.579927 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-8cc5b2c7-67db-4c9f-a7b2-4f52e0270e08 req-4cbff0bd-259c-44b3-8ccd-505c829ba254 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:14.581990 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-8cc5b2c7-67db-4c9f-a7b2-4f52e0270e08 req-4cbff0bd-259c-44b3-8ccd-505c829ba254 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:14.583255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-8cc5b2c7-67db-4c9f-a7b2-4f52e0270e08 req-4cbff0bd-259c-44b3-8ccd-505c829ba254 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:14.618470 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-8cc5b2c7-67db-4c9f-a7b2-4f52e0270e08 req-4cbff0bd-259c-44b3-8ccd-505c829ba254 service nova] Creating event network-changed:08518c24-70ef-4c17-a240-418e5eae2128 for instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d on hv-cinder-85200 Aug 05 07:19:14.629183 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-8cc5b2c7-67db-4c9f-a7b2-4f52e0270e08 req-4cbff0bd-259c-44b3-8ccd-505c829ba254 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082918 Aug 05 07:19:14.630817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 267/525] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:19:14.720939 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e2d6fde3-e413-43b6-9d61-49d968c93475 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:14.727274 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:14.738978 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e2d6fde3-e413-43b6-9d61-49d968c93475 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.233474 Aug 05 07:19:14.740116 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 259/526] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:14 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:15.102183 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-52146e57-8cc6-4ce7-8107-5a9b882d1d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:15.103388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-52146e57-8cc6-4ce7-8107-5a9b882d1d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:15.113259 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52146e57-8cc6-4ce7-8107-5a9b882d1d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:15.114060 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52146e57-8cc6-4ce7-8107-5a9b882d1d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:15.115093 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52146e57-8cc6-4ce7-8107-5a9b882d1d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:15.116386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52146e57-8cc6-4ce7-8107-5a9b882d1d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:15.117411 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52146e57-8cc6-4ce7-8107-5a9b882d1d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:15.118008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52146e57-8cc6-4ce7-8107-5a9b882d1d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:15.521480 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-52146e57-8cc6-4ce7-8107-5a9b882d1d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:15.539325 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-52146e57-8cc6-4ce7-8107-5a9b882d1d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:15.543141 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-52146e57-8cc6-4ce7-8107-5a9b882d1d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:15.545622 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-52146e57-8cc6-4ce7-8107-5a9b882d1d12 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.450338 Aug 05 07:19:15.546637 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 268/527] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:15 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:19:15.766104 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d6d75129-3433-417d-9998-916f40a66765 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:15.766966 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d6d75129-3433-417d-9998-916f40a66765 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:15.774727 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6d75129-3433-417d-9998-916f40a66765 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:15.775213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6d75129-3433-417d-9998-916f40a66765 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:15.775637 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6d75129-3433-417d-9998-916f40a66765 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:15.776646 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6d75129-3433-417d-9998-916f40a66765 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:15.777131 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6d75129-3433-417d-9998-916f40a66765 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:15.777551 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6d75129-3433-417d-9998-916f40a66765 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:15.964936 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d6d75129-3433-417d-9998-916f40a66765 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:15.974170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d6d75129-3433-417d-9998-916f40a66765 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.213714 Aug 05 07:19:15.974770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 260/528] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:15 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:16.580450 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1412e9e7-f832-4c79-b885-04c02faf59c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:16.581154 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1412e9e7-f832-4c79-b885-04c02faf59c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:16.588530 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1412e9e7-f832-4c79-b885-04c02faf59c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:16.589072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1412e9e7-f832-4c79-b885-04c02faf59c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:16.589490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1412e9e7-f832-4c79-b885-04c02faf59c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:16.590234 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1412e9e7-f832-4c79-b885-04c02faf59c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:16.590693 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1412e9e7-f832-4c79-b885-04c02faf59c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:16.591120 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1412e9e7-f832-4c79-b885-04c02faf59c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:16.667959 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-d2900e3f-cd14-4b2f-b19e-7520a570f9e6 req-e92aec15-37ad-466e-b76a-15bc43d24de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d20686-267a-4bf7-b36b-7a248b0c3d8d", "tag": "08518c24-70ef-4c17-a240-418e5eae2128"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:19:16.685396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d2900e3f-cd14-4b2f-b19e-7520a570f9e6 req-e92aec15-37ad-466e-b76a-15bc43d24de1 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:16.686186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d2900e3f-cd14-4b2f-b19e-7520a570f9e6 req-e92aec15-37ad-466e-b76a-15bc43d24de1 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:16.686659 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d2900e3f-cd14-4b2f-b19e-7520a570f9e6 req-e92aec15-37ad-466e-b76a-15bc43d24de1 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:16.705445 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-d2900e3f-cd14-4b2f-b19e-7520a570f9e6 req-e92aec15-37ad-466e-b76a-15bc43d24de1 service nova] Creating event network-changed:08518c24-70ef-4c17-a240-418e5eae2128 for instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d on hv-cinder-85200 Aug 05 07:19:16.711610 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-d2900e3f-cd14-4b2f-b19e-7520a570f9e6 req-e92aec15-37ad-466e-b76a-15bc43d24de1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049447 Aug 05 07:19:16.712633 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 261/529] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:19:16.765374 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1412e9e7-f832-4c79-b885-04c02faf59c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:16.790548 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1412e9e7-f832-4c79-b885-04c02faf59c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:16.794117 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1412e9e7-f832-4c79-b885-04c02faf59c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:16.796490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1412e9e7-f832-4c79-b885-04c02faf59c7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.219730 Aug 05 07:19:16.797545 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 269/530] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:16 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:16.898019 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-fd1b0d20-b146-49b1-928f-68c8c8f69c69 req-d508d944-0747-44c6-8550-6694e250aa4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f664511a-28db-4ff6-90e9-7e2db58e94e2", "name": "network-vif-plugged", "status": "completed", "tag": "986a1785-c18c-444a-af3e-101b2ea68ae7"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:19:16.916531 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-fd1b0d20-b146-49b1-928f-68c8c8f69c69 req-d508d944-0747-44c6-8550-6694e250aa4e service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:16.917382 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-fd1b0d20-b146-49b1-928f-68c8c8f69c69 req-d508d944-0747-44c6-8550-6694e250aa4e service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:16.918116 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-fd1b0d20-b146-49b1-928f-68c8c8f69c69 req-d508d944-0747-44c6-8550-6694e250aa4e service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:16.943146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-fd1b0d20-b146-49b1-928f-68c8c8f69c69 req-d508d944-0747-44c6-8550-6694e250aa4e service nova] Creating event network-vif-plugged:986a1785-c18c-444a-af3e-101b2ea68ae7 for instance f664511a-28db-4ff6-90e9-7e2db58e94e2 on hv-cinder-85200 Aug 05 07:19:16.952202 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-fd1b0d20-b146-49b1-928f-68c8c8f69c69 req-d508d944-0747-44c6-8550-6694e250aa4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062963 Aug 05 07:19:16.953707 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 262/531] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:19:17.001476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-926f517c-c933-43f4-ae76-ce93a7835185 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:17.002111 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-926f517c-c933-43f4-ae76-ce93a7835185 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:17.008770 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-926f517c-c933-43f4-ae76-ce93a7835185 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:17.009313 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-926f517c-c933-43f4-ae76-ce93a7835185 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:17.009758 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-926f517c-c933-43f4-ae76-ce93a7835185 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:17.010482 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-926f517c-c933-43f4-ae76-ce93a7835185 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:17.010943 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-926f517c-c933-43f4-ae76-ce93a7835185 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:17.011369 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-926f517c-c933-43f4-ae76-ce93a7835185 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:17.200182 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-926f517c-c933-43f4-ae76-ce93a7835185 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:17.209175 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-926f517c-c933-43f4-ae76-ce93a7835185 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.213477 Aug 05 07:19:17.210109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 270/532] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:16 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:17.829145 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a6dc6b06-54db-4f56-a15b-a477fa7fb359 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:17.829864 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a6dc6b06-54db-4f56-a15b-a477fa7fb359 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:17.837110 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6dc6b06-54db-4f56-a15b-a477fa7fb359 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:17.837613 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6dc6b06-54db-4f56-a15b-a477fa7fb359 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:17.838049 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6dc6b06-54db-4f56-a15b-a477fa7fb359 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:17.839654 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6dc6b06-54db-4f56-a15b-a477fa7fb359 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:17.839654 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6dc6b06-54db-4f56-a15b-a477fa7fb359 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:17.839654 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6dc6b06-54db-4f56-a15b-a477fa7fb359 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:17.994467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a6dc6b06-54db-4f56-a15b-a477fa7fb359 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:18.004859 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a6dc6b06-54db-4f56-a15b-a477fa7fb359 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:18.006416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a6dc6b06-54db-4f56-a15b-a477fa7fb359 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:18.007619 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a6dc6b06-54db-4f56-a15b-a477fa7fb359 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.183793 Aug 05 07:19:18.008206 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 263/533] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:17 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:18.234739 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-264b1b5f-c026-49aa-89c7-4c56d39cefe1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:18.235378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-264b1b5f-c026-49aa-89c7-4c56d39cefe1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:18.242359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-264b1b5f-c026-49aa-89c7-4c56d39cefe1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:18.242862 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-264b1b5f-c026-49aa-89c7-4c56d39cefe1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:18.243313 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-264b1b5f-c026-49aa-89c7-4c56d39cefe1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:18.244062 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-264b1b5f-c026-49aa-89c7-4c56d39cefe1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:18.244536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-264b1b5f-c026-49aa-89c7-4c56d39cefe1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:18.245026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-264b1b5f-c026-49aa-89c7-4c56d39cefe1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:18.473673 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-264b1b5f-c026-49aa-89c7-4c56d39cefe1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:18.482383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-264b1b5f-c026-49aa-89c7-4c56d39cefe1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.251773 Aug 05 07:19:18.483235 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 271/534] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:18 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:19.031889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5be6a027-7c63-46e3-98e6-14a93e8dd292 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:19.032593 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5be6a027-7c63-46e3-98e6-14a93e8dd292 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:19.039594 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5be6a027-7c63-46e3-98e6-14a93e8dd292 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:19.040075 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5be6a027-7c63-46e3-98e6-14a93e8dd292 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:19.040513 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5be6a027-7c63-46e3-98e6-14a93e8dd292 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:19.041275 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5be6a027-7c63-46e3-98e6-14a93e8dd292 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:19.041729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5be6a027-7c63-46e3-98e6-14a93e8dd292 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:19.042154 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5be6a027-7c63-46e3-98e6-14a93e8dd292 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:19.200155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5be6a027-7c63-46e3-98e6-14a93e8dd292 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:19.210051 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5be6a027-7c63-46e3-98e6-14a93e8dd292 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:19.211606 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5be6a027-7c63-46e3-98e6-14a93e8dd292 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:19.212833 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5be6a027-7c63-46e3-98e6-14a93e8dd292 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.185296 Aug 05 07:19:19.213570 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 264/535] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:19 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:19.513677 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1f43720b-44f1-4284-8d53-b3efa64f0ca4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:19.514412 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1f43720b-44f1-4284-8d53-b3efa64f0ca4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:19.517508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=60 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:19.524379 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f43720b-44f1-4284-8d53-b3efa64f0ca4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:19.525000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f43720b-44f1-4284-8d53-b3efa64f0ca4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:19.525482 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f43720b-44f1-4284-8d53-b3efa64f0ca4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:19.526211 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f43720b-44f1-4284-8d53-b3efa64f0ca4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:19.526755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f43720b-44f1-4284-8d53-b3efa64f0ca4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:19.527237 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f43720b-44f1-4284-8d53-b3efa64f0ca4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:19.696810 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1f43720b-44f1-4284-8d53-b3efa64f0ca4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:19.711316 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1f43720b-44f1-4284-8d53-b3efa64f0ca4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.201420 Aug 05 07:19:19.712401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 272/536] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:19 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:20.238527 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-810559d2-16b8-4162-8626-ec45cfd282a3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:20.239343 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-810559d2-16b8-4162-8626-ec45cfd282a3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:20.247410 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-810559d2-16b8-4162-8626-ec45cfd282a3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:20.248246 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-810559d2-16b8-4162-8626-ec45cfd282a3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:20.248864 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-810559d2-16b8-4162-8626-ec45cfd282a3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:20.250200 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-810559d2-16b8-4162-8626-ec45cfd282a3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:20.250712 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-810559d2-16b8-4162-8626-ec45cfd282a3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:20.251235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-810559d2-16b8-4162-8626-ec45cfd282a3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:20.431292 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-810559d2-16b8-4162-8626-ec45cfd282a3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:20.448199 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-810559d2-16b8-4162-8626-ec45cfd282a3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:20.451881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-810559d2-16b8-4162-8626-ec45cfd282a3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:20.454156 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-810559d2-16b8-4162-8626-ec45cfd282a3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1808 microversion: 2.20 time: 0.221114 Aug 05 07:19:20.455198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 265/537] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:20 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:19:20.733672 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0de2bd9e-abc9-4b60-9161-514f40fc2ff4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:20.734547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0de2bd9e-abc9-4b60-9161-514f40fc2ff4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:20.742265 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0de2bd9e-abc9-4b60-9161-514f40fc2ff4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:20.742770 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0de2bd9e-abc9-4b60-9161-514f40fc2ff4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:20.743214 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0de2bd9e-abc9-4b60-9161-514f40fc2ff4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:20.743950 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0de2bd9e-abc9-4b60-9161-514f40fc2ff4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:20.744413 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0de2bd9e-abc9-4b60-9161-514f40fc2ff4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:20.744849 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0de2bd9e-abc9-4b60-9161-514f40fc2ff4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:20.895929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0de2bd9e-abc9-4b60-9161-514f40fc2ff4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:20.905246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0de2bd9e-abc9-4b60-9161-514f40fc2ff4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1678 microversion: 2.1 time: 0.175568 Aug 05 07:19:20.905915 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 273/538] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:20 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:21.483309 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a68ffc96-78bc-4633-b28a-20a602dea11d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:21.483973 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a68ffc96-78bc-4633-b28a-20a602dea11d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:21.491512 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a68ffc96-78bc-4633-b28a-20a602dea11d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:21.492020 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a68ffc96-78bc-4633-b28a-20a602dea11d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:21.492456 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a68ffc96-78bc-4633-b28a-20a602dea11d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:21.493290 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a68ffc96-78bc-4633-b28a-20a602dea11d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:21.493750 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a68ffc96-78bc-4633-b28a-20a602dea11d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:21.494218 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a68ffc96-78bc-4633-b28a-20a602dea11d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:21.651656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a68ffc96-78bc-4633-b28a-20a602dea11d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:21.661080 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a68ffc96-78bc-4633-b28a-20a602dea11d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:21.662664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a68ffc96-78bc-4633-b28a-20a602dea11d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:21.663881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a68ffc96-78bc-4633-b28a-20a602dea11d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1795 microversion: 2.20 time: 0.184708 Aug 05 07:19:21.664434 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 266/539] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:19:21 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1795 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:19:21.929247 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-edb1b473-e0a8-415d-9f10-e14d8eb4778c tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:21.929909 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-edb1b473-e0a8-415d-9f10-e14d8eb4778c tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:21.938095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-edb1b473-e0a8-415d-9f10-e14d8eb4778c tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:21.938733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-edb1b473-e0a8-415d-9f10-e14d8eb4778c tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:21.939267 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-edb1b473-e0a8-415d-9f10-e14d8eb4778c tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:21.940133 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-edb1b473-e0a8-415d-9f10-e14d8eb4778c tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:21.940680 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-edb1b473-e0a8-415d-9f10-e14d8eb4778c tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:21.941173 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-edb1b473-e0a8-415d-9f10-e14d8eb4778c tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:22.098393 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-edb1b473-e0a8-415d-9f10-e14d8eb4778c tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:22.107187 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-edb1b473-e0a8-415d-9f10-e14d8eb4778c tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1655 microversion: 2.1 time: 0.182959 Aug 05 07:19:22.107998 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 274/540] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:21 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1655 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:22.129368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b4a3b6aa-8716-4600-a50f-9b5e976d18bb tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:19:22.137586 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4a3b6aa-8716-4600-a50f-9b5e976d18bb tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:22.138236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4a3b6aa-8716-4600-a50f-9b5e976d18bb tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:22.138905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4a3b6aa-8716-4600-a50f-9b5e976d18bb tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:22.173996 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b4a3b6aa-8716-4600-a50f-9b5e976d18bb tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Going to try to start instance {{(pid=117893) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 07:19:22.244440 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b4a3b6aa-8716-4600-a50f-9b5e976d18bb tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "POST /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/action" status: 202 len: 0 microversion: 2.1 time: 0.119461 Aug 05 07:19:22.245669 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 267/541] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:19:22 2022] POST /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:19:22.256570 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1747b6eb-df18-4ae3-9746-60e1fcd1fc2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:22.257714 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1747b6eb-df18-4ae3-9746-60e1fcd1fc2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:22.268147 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1747b6eb-df18-4ae3-9746-60e1fcd1fc2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:22.269303 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1747b6eb-df18-4ae3-9746-60e1fcd1fc2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:22.270429 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1747b6eb-df18-4ae3-9746-60e1fcd1fc2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:22.271670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1747b6eb-df18-4ae3-9746-60e1fcd1fc2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:22.272409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1747b6eb-df18-4ae3-9746-60e1fcd1fc2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:22.273381 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1747b6eb-df18-4ae3-9746-60e1fcd1fc2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:22.462077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1747b6eb-df18-4ae3-9746-60e1fcd1fc2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:22.475086 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1747b6eb-df18-4ae3-9746-60e1fcd1fc2f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1664 microversion: 2.1 time: 0.223411 Aug 05 07:19:22.475970 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 275/542] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:22 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1664 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:23.508020 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-def61446-c151-4d10-9166-31622d61a5ec tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:23.509277 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-def61446-c151-4d10-9166-31622d61a5ec tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:23.520860 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-def61446-c151-4d10-9166-31622d61a5ec tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:23.521775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-def61446-c151-4d10-9166-31622d61a5ec tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:23.522511 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-def61446-c151-4d10-9166-31622d61a5ec tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:23.523734 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-def61446-c151-4d10-9166-31622d61a5ec tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:23.524523 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-def61446-c151-4d10-9166-31622d61a5ec tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:23.525331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-def61446-c151-4d10-9166-31622d61a5ec tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:23.685812 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-def61446-c151-4d10-9166-31622d61a5ec tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:23.694744 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-def61446-c151-4d10-9166-31622d61a5ec tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1664 microversion: 2.1 time: 0.195385 Aug 05 07:19:23.695338 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 268/543] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:23 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1664 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:24.733088 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-316ffcb4-d1ed-4be8-baa0-872bb175895b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:24.734187 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-316ffcb4-d1ed-4be8-baa0-872bb175895b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:24.746247 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-316ffcb4-d1ed-4be8-baa0-872bb175895b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:24.747077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-316ffcb4-d1ed-4be8-baa0-872bb175895b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:24.747818 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-316ffcb4-d1ed-4be8-baa0-872bb175895b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:24.749166 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-316ffcb4-d1ed-4be8-baa0-872bb175895b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:24.749967 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-316ffcb4-d1ed-4be8-baa0-872bb175895b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:24.750708 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-316ffcb4-d1ed-4be8-baa0-872bb175895b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:24.964796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-316ffcb4-d1ed-4be8-baa0-872bb175895b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:24.974490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-316ffcb4-d1ed-4be8-baa0-872bb175895b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1668 microversion: 2.1 time: 0.248597 Aug 05 07:19:24.975131 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 276/544] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:24 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1668 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:32.956702 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1083c03e-92a7-41c5-969f-54c2eaa17fbb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:32.957381 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1083c03e-92a7-41c5-969f-54c2eaa17fbb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:32.963693 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1083c03e-92a7-41c5-969f-54c2eaa17fbb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:32.964200 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1083c03e-92a7-41c5-969f-54c2eaa17fbb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:32.964630 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1083c03e-92a7-41c5-969f-54c2eaa17fbb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:32.965357 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1083c03e-92a7-41c5-969f-54c2eaa17fbb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:32.965800 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1083c03e-92a7-41c5-969f-54c2eaa17fbb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:32.966211 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1083c03e-92a7-41c5-969f-54c2eaa17fbb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:32.994614 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1083c03e-92a7-41c5-969f-54c2eaa17fbb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1/ips" status: 200 len: 150 microversion: 2.1 time: 0.110035 Aug 05 07:19:32.995208 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 269/545] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 5 07:19:32 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1/ips => generated 150 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:19:33.007954 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0e3426c1-8bcc-4d88-af0c-daa6a58d1a60 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03292344-940a-4280-8d04-9c62310c3f9c"}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:19:33.010478 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0e3426c1-8bcc-4d88-af0c-daa6a58d1a60 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:33.017404 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0e3426c1-8bcc-4d88-af0c-daa6a58d1a60 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:33.017890 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0e3426c1-8bcc-4d88-af0c-daa6a58d1a60 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:33.018355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0e3426c1-8bcc-4d88-af0c-daa6a58d1a60 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:33.019059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0e3426c1-8bcc-4d88-af0c-daa6a58d1a60 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:33.019879 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0e3426c1-8bcc-4d88-af0c-daa6a58d1a60 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:33.020306 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0e3426c1-8bcc-4d88-af0c-daa6a58d1a60 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:33.108421 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-0e3426c1-8bcc-4d88-af0c-daa6a58d1a60 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Invalid volume: volume 03292344-940a-4280-8d04-9c62310c3f9c is already attached to instances: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0e3426c1-8bcc-4d88-af0c-daa6a58d1a60 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: POST /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1/os-volume_attachments HTTP/1.1 Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 74 Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:19:33.110377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:19:33.112794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:19:33.112794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:19:33.112794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:19:33.112794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:19:33.112794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:19:33.112794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:19:33.112794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:19:33.112794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:19:33.112794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:19:33.112794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Aug 05 07:19:33.112794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {"volumeAttachment": {"volumeId": "03292344-940a-4280-8d04-9c62310c3f9c"}} Aug 05 07:19:33.112794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Invalid volume: volume 03292344-940a-4280-8d04-9c62310c3f9c is already attached to instances: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'server_id': 'ffbeb5f6-8ae7-4d07-b089-62cc142fddb1', 'body': {'volumeAttachment': {'volumeId': '03292344-940a-4280-8d04-9c62310c3f9c'}}} Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 03292344-940a-4280-8d04-9c62310c3f9c is already attached to instances: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:19:33.118466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 03292344-940a-4280-8d04-9c62310c3f9c is already attached to instances: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:19:33.120536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:19:33.122936 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:19:33.122936 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:19:33.122936 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:19:33.122936 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 03292344-940a-4280-8d04-9c62310c3f9c is already attached to instances: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 Aug 05 07:19:33.122936 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:19:33.122936 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0e3426c1-8bcc-4d88-af0c-daa6a58d1a60 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 400 to user: Invalid volume: volume 03292344-940a-4280-8d04-9c62310c3f9c is already attached to instances: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:19:33.122936 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0e3426c1-8bcc-4d88-af0c-daa6a58d1a60 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108580 Aug 05 07:19:33.122936 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 277/546] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:19:33 2022] POST /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 07:19:33.123717 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-528e75d3-4c5f-4c88-89b8-40d328224aea tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:33.124213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-528e75d3-4c5f-4c88-89b8-40d328224aea tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:33.131876 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-528e75d3-4c5f-4c88-89b8-40d328224aea tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:33.132395 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-528e75d3-4c5f-4c88-89b8-40d328224aea tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:33.132835 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-528e75d3-4c5f-4c88-89b8-40d328224aea tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:33.133598 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-528e75d3-4c5f-4c88-89b8-40d328224aea tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:33.134059 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-528e75d3-4c5f-4c88-89b8-40d328224aea tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:33.134486 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-528e75d3-4c5f-4c88-89b8-40d328224aea tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:33.172672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-528e75d3-4c5f-4c88-89b8-40d328224aea tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:19:33.268087 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-528e75d3-4c5f-4c88-89b8-40d328224aea tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 204 len: 0 microversion: 2.1 time: 0.147553 Aug 05 07:19:33.268986 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 270/547] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:19:33 2022] DELETE /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:19:33.282184 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0951bfc1-0e4d-4955-92cf-4c0db16394da tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:33.283407 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0951bfc1-0e4d-4955-92cf-4c0db16394da tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:33.295185 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0951bfc1-0e4d-4955-92cf-4c0db16394da tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:33.296037 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0951bfc1-0e4d-4955-92cf-4c0db16394da tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:33.296743 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0951bfc1-0e4d-4955-92cf-4c0db16394da tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:33.298043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0951bfc1-0e4d-4955-92cf-4c0db16394da tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:33.298870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0951bfc1-0e4d-4955-92cf-4c0db16394da tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:33.299618 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0951bfc1-0e4d-4955-92cf-4c0db16394da tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:33.333401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:33.474263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0951bfc1-0e4d-4955-92cf-4c0db16394da tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:33.482609 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0951bfc1-0e4d-4955-92cf-4c0db16394da tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1680 microversion: 2.1 time: 0.207771 Aug 05 07:19:33.483253 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 278/548] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:33 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:34.504917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0ee003ab-95ee-4113-bd7f-163d2edf1a68 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:34.505687 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0ee003ab-95ee-4113-bd7f-163d2edf1a68 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:34.513076 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0ee003ab-95ee-4113-bd7f-163d2edf1a68 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:34.513557 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0ee003ab-95ee-4113-bd7f-163d2edf1a68 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:34.513995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0ee003ab-95ee-4113-bd7f-163d2edf1a68 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:34.514692 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0ee003ab-95ee-4113-bd7f-163d2edf1a68 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:34.515138 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0ee003ab-95ee-4113-bd7f-163d2edf1a68 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:34.515556 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0ee003ab-95ee-4113-bd7f-163d2edf1a68 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:34.675818 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0ee003ab-95ee-4113-bd7f-163d2edf1a68 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:34.684637 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0ee003ab-95ee-4113-bd7f-163d2edf1a68 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1680 microversion: 2.1 time: 0.184147 Aug 05 07:19:34.685283 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 271/549] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:34 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:35.708537 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-95de1e62-df72-4db9-91a0-4ae64042d65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:35.709681 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-95de1e62-df72-4db9-91a0-4ae64042d65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:35.719676 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95de1e62-df72-4db9-91a0-4ae64042d65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:35.720172 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95de1e62-df72-4db9-91a0-4ae64042d65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:35.720655 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95de1e62-df72-4db9-91a0-4ae64042d65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:35.721435 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95de1e62-df72-4db9-91a0-4ae64042d65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:35.721899 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95de1e62-df72-4db9-91a0-4ae64042d65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:35.722339 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95de1e62-df72-4db9-91a0-4ae64042d65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:36.101414 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-95de1e62-df72-4db9-91a0-4ae64042d65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:36.109870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-95de1e62-df72-4db9-91a0-4ae64042d65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1680 microversion: 2.1 time: 0.406104 Aug 05 07:19:36.110576 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 279/550] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:35 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1680 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:37.135441 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fda540b7-5bac-4c68-9dd8-b3e4c68ba531 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:37.136586 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fda540b7-5bac-4c68-9dd8-b3e4c68ba531 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:37.149784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fda540b7-5bac-4c68-9dd8-b3e4c68ba531 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:37.150749 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fda540b7-5bac-4c68-9dd8-b3e4c68ba531 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:37.151590 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fda540b7-5bac-4c68-9dd8-b3e4c68ba531 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:37.152983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fda540b7-5bac-4c68-9dd8-b3e4c68ba531 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:37.153918 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fda540b7-5bac-4c68-9dd8-b3e4c68ba531 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:37.154705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fda540b7-5bac-4c68-9dd8-b3e4c68ba531 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:37.285110 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fda540b7-5bac-4c68-9dd8-b3e4c68ba531 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:37.301204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fda540b7-5bac-4c68-9dd8-b3e4c68ba531 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 200 len: 1615 microversion: 2.1 time: 0.171738 Aug 05 07:19:37.303509 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 272/551] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:37 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 1615 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:37.368726 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-13320a82-884f-431e-a561-66075feeb40c req-cc7d2a76-4e34-441f-a3fd-b8627132bef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbeb5f6-8ae7-4d07-b089-62cc142fddb1", "name": "network-vif-deleted", "tag": "b91dfe51-18b8-4867-aa8f-b69a34991b20"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:19:37.400702 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-13320a82-884f-431e-a561-66075feeb40c req-cc7d2a76-4e34-441f-a3fd-b8627132bef9 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:37.410260 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-13320a82-884f-431e-a561-66075feeb40c req-cc7d2a76-4e34-441f-a3fd-b8627132bef9 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:37.411448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-13320a82-884f-431e-a561-66075feeb40c req-cc7d2a76-4e34-441f-a3fd-b8627132bef9 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:37.441847 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-13320a82-884f-431e-a561-66075feeb40c req-cc7d2a76-4e34-441f-a3fd-b8627132bef9 service nova] Creating event network-vif-deleted:b91dfe51-18b8-4867-aa8f-b69a34991b20 for instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 on hv-cinder-85200 Aug 05 07:19:37.455699 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-13320a82-884f-431e-a561-66075feeb40c req-cc7d2a76-4e34-441f-a3fd-b8627132bef9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202811 Aug 05 07:19:37.457053 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 280/552] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:19:38.334923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-58310fc1-cb44-4815-bf6b-79cb3c9af076 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:38.335669 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-58310fc1-cb44-4815-bf6b-79cb3c9af076 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:38.342795 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-58310fc1-cb44-4815-bf6b-79cb3c9af076 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:38.343576 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-58310fc1-cb44-4815-bf6b-79cb3c9af076 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:38.344187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-58310fc1-cb44-4815-bf6b-79cb3c9af076 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:38.345136 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-58310fc1-cb44-4815-bf6b-79cb3c9af076 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:38.345751 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-58310fc1-cb44-4815-bf6b-79cb3c9af076 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:38.346341 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-58310fc1-cb44-4815-bf6b-79cb3c9af076 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:38.362187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-58310fc1-cb44-4815-bf6b-79cb3c9af076 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-58310fc1-cb44-4815-bf6b-79cb3c9af076 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 HTTP/1.1 Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:19:38.363848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:19:38.366176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:19:38.366176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:19:38.366176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:19:38.366176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:19:38.366176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:19:38.366176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:19:38.366176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:19:38.366176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:19:38.366176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:19:38.366176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:19:38.366176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:19:38.366176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'ffbeb5f6-8ae7-4d07-b089-62cc142fddb1'} Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:19:38.367747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:19:38.372542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:38.375311 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-58310fc1-cb44-4815-bf6b-79cb3c9af076 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 404 to user: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:19:38.375311 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-58310fc1-cb44-4815-bf6b-79cb3c9af076 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 404 len: 111 microversion: 2.1 time: 0.034513 Aug 05 07:19:38.375311 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 273/553] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:38 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 07:19:38.385214 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-43d74465-eccc-45bd-ac36-4906322a8353 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '.version_select at 0x7f497002f3a0>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:38.431013 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-43d74465-eccc-45bd-ac36-4906322a8353 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764988882" status: 202 len: 0 microversion: 2.1 time: 0.054909 Aug 05 07:19:38.432262 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 281/554] 10.222.0.27 () {58 vars in 1221 bytes} [Fri Aug 5 07:19:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764988882 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:19:39.540018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ce37eb43-87aa-4bbf-8cb9-2a4b1080392c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:39.540877 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ce37eb43-87aa-4bbf-8cb9-2a4b1080392c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:39.551544 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce37eb43-87aa-4bbf-8cb9-2a4b1080392c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:39.552174 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce37eb43-87aa-4bbf-8cb9-2a4b1080392c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:39.552711 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce37eb43-87aa-4bbf-8cb9-2a4b1080392c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:39.553673 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce37eb43-87aa-4bbf-8cb9-2a4b1080392c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:39.554330 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce37eb43-87aa-4bbf-8cb9-2a4b1080392c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:39.555037 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce37eb43-87aa-4bbf-8cb9-2a4b1080392c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:39.662972 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-ce37eb43-87aa-4bbf-8cb9-2a4b1080392c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lazy-loading 'services' on Instance uuid 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:19:39.758694 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ce37eb43-87aa-4bbf-8cb9-2a4b1080392c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/os-volume_attachments/03292344-940a-4280-8d04-9c62310c3f9c" status: 202 len: 0 microversion: 2.1 time: 0.222587 Aug 05 07:19:39.759347 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 274/555] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 5 07:19:39 2022] DELETE /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/os-volume_attachments/03292344-940a-4280-8d04-9c62310c3f9c => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 07:19:39.770907 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d7541755-7bab-4a69-853f-e5ddca66da95 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:39.773890 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d7541755-7bab-4a69-853f-e5ddca66da95 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:39.784794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d7541755-7bab-4a69-853f-e5ddca66da95 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:39.785382 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d7541755-7bab-4a69-853f-e5ddca66da95 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:39.785922 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d7541755-7bab-4a69-853f-e5ddca66da95 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:39.786818 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d7541755-7bab-4a69-853f-e5ddca66da95 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:39.787372 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d7541755-7bab-4a69-853f-e5ddca66da95 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:39.787917 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d7541755-7bab-4a69-853f-e5ddca66da95 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:39.828947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d7541755-7bab-4a69-853f-e5ddca66da95 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064296 Aug 05 07:19:39.829623 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 282/556] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:19:39 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:19:40.845159 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-371cdd7b-3f40-4c7d-a369-7b9c4dfd0f23 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:40.848104 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-371cdd7b-3f40-4c7d-a369-7b9c4dfd0f23 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:40.855493 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-371cdd7b-3f40-4c7d-a369-7b9c4dfd0f23 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:40.855983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-371cdd7b-3f40-4c7d-a369-7b9c4dfd0f23 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:40.856421 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-371cdd7b-3f40-4c7d-a369-7b9c4dfd0f23 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:40.857256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-371cdd7b-3f40-4c7d-a369-7b9c4dfd0f23 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:40.857710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-371cdd7b-3f40-4c7d-a369-7b9c4dfd0f23 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:40.858140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-371cdd7b-3f40-4c7d-a369-7b9c4dfd0f23 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:40.877837 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:40.898929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-371cdd7b-3f40-4c7d-a369-7b9c4dfd0f23 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060308 Aug 05 07:19:40.899821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 275/557] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:19:40 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:19:41.911636 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-589ecff1-ed2c-46e7-97ce-f32d91607715 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:41.913897 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-589ecff1-ed2c-46e7-97ce-f32d91607715 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:41.922477 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-589ecff1-ed2c-46e7-97ce-f32d91607715 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:41.923193 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-589ecff1-ed2c-46e7-97ce-f32d91607715 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:41.923642 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-589ecff1-ed2c-46e7-97ce-f32d91607715 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:41.924376 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-589ecff1-ed2c-46e7-97ce-f32d91607715 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:41.924858 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-589ecff1-ed2c-46e7-97ce-f32d91607715 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:41.925336 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-589ecff1-ed2c-46e7-97ce-f32d91607715 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:41.961835 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-589ecff1-ed2c-46e7-97ce-f32d91607715 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054524 Aug 05 07:19:41.962441 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 283/558] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:19:41 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 07:19:42.034155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-02bf80f4-c3e8-46e1-9de1-c59b6083b682 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:42.034858 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-02bf80f4-c3e8-46e1-9de1-c59b6083b682 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:42.042648 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02bf80f4-c3e8-46e1-9de1-c59b6083b682 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:42.043206 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02bf80f4-c3e8-46e1-9de1-c59b6083b682 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:42.043751 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02bf80f4-c3e8-46e1-9de1-c59b6083b682 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:42.044932 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02bf80f4-c3e8-46e1-9de1-c59b6083b682 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:42.045456 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02bf80f4-c3e8-46e1-9de1-c59b6083b682 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:42.045917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02bf80f4-c3e8-46e1-9de1-c59b6083b682 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:42.074811 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-02bf80f4-c3e8-46e1-9de1-c59b6083b682 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:19:42.176927 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-02bf80f4-c3e8-46e1-9de1-c59b6083b682 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 204 len: 0 microversion: 2.1 time: 0.145919 Aug 05 07:19:42.177881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 276/559] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:19:42 2022] DELETE /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:19:42.187768 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ee4ce2ad-0df8-482f-8e06-2a5d2550c428 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:42.188423 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ee4ce2ad-0df8-482f-8e06-2a5d2550c428 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:42.195305 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee4ce2ad-0df8-482f-8e06-2a5d2550c428 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:42.195923 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee4ce2ad-0df8-482f-8e06-2a5d2550c428 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:42.196399 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee4ce2ad-0df8-482f-8e06-2a5d2550c428 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:42.197208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee4ce2ad-0df8-482f-8e06-2a5d2550c428 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:42.197736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee4ce2ad-0df8-482f-8e06-2a5d2550c428 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:42.198199 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee4ce2ad-0df8-482f-8e06-2a5d2550c428 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:42.350945 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ee4ce2ad-0df8-482f-8e06-2a5d2550c428 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:42.359809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ee4ce2ad-0df8-482f-8e06-2a5d2550c428 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1681 microversion: 2.1 time: 0.176925 Aug 05 07:19:42.360386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 284/560] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:42 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:43.383691 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7625a7ea-01c9-41da-87b7-fc7a8b60c8af tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:43.384407 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7625a7ea-01c9-41da-87b7-fc7a8b60c8af tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:43.387264 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:43.393236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7625a7ea-01c9-41da-87b7-fc7a8b60c8af tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:43.394078 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7625a7ea-01c9-41da-87b7-fc7a8b60c8af tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:43.394524 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7625a7ea-01c9-41da-87b7-fc7a8b60c8af tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:43.395323 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7625a7ea-01c9-41da-87b7-fc7a8b60c8af tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:43.395766 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7625a7ea-01c9-41da-87b7-fc7a8b60c8af tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:43.396196 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7625a7ea-01c9-41da-87b7-fc7a8b60c8af tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:43.559331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7625a7ea-01c9-41da-87b7-fc7a8b60c8af tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:43.569881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7625a7ea-01c9-41da-87b7-fc7a8b60c8af tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1681 microversion: 2.1 time: 0.190569 Aug 05 07:19:43.570471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 277/561] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:43 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:44.592059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-65b6f3f5-2e41-42d7-873a-243cd1fe1dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:44.592707 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-65b6f3f5-2e41-42d7-873a-243cd1fe1dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:44.600397 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-65b6f3f5-2e41-42d7-873a-243cd1fe1dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:44.600886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-65b6f3f5-2e41-42d7-873a-243cd1fe1dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:44.601365 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-65b6f3f5-2e41-42d7-873a-243cd1fe1dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:44.602102 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-65b6f3f5-2e41-42d7-873a-243cd1fe1dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:44.602552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-65b6f3f5-2e41-42d7-873a-243cd1fe1dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:44.602975 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-65b6f3f5-2e41-42d7-873a-243cd1fe1dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:44.846461 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-65b6f3f5-2e41-42d7-873a-243cd1fe1dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:44.857029 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-65b6f3f5-2e41-42d7-873a-243cd1fe1dad tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1681 microversion: 2.1 time: 0.268752 Aug 05 07:19:44.857739 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 285/562] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:44 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1681 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:45.568763 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-0f967f30-33f4-4d51-b2d3-e4201dbb3691 req-c359b0f1-d486-420c-a223-838907431e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c3c22d-3c48-4d1b-8ee9-29c1e3268147", "name": "network-vif-deleted", "tag": "27f2f9c3-a397-478f-89d5-adb7b9c5e4af"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:19:45.585513 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0f967f30-33f4-4d51-b2d3-e4201dbb3691 req-c359b0f1-d486-420c-a223-838907431e70 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:45.586298 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0f967f30-33f4-4d51-b2d3-e4201dbb3691 req-c359b0f1-d486-420c-a223-838907431e70 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:45.586731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0f967f30-33f4-4d51-b2d3-e4201dbb3691 req-c359b0f1-d486-420c-a223-838907431e70 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:45.616578 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-0f967f30-33f4-4d51-b2d3-e4201dbb3691 req-c359b0f1-d486-420c-a223-838907431e70 service nova] Creating event network-vif-deleted:27f2f9c3-a397-478f-89d5-adb7b9c5e4af for instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 on hv-cinder-85200 Aug 05 07:19:45.623389 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-0f967f30-33f4-4d51-b2d3-e4201dbb3691 req-c359b0f1-d486-420c-a223-838907431e70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058569 Aug 05 07:19:45.623961 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 278/563] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:19:45.894231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:45.895088 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:45.906733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:45.907611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:45.908194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:45.909503 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:45.910346 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:45.910929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:45.960089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:45.960699 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:45.961394 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:45.961946 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lazy-loading 'fault' on Instance uuid 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:19:46.016396 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:46.025485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8dfdc559-c35e-459e-9a15-8abbf64374d5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 200 len: 1331 microversion: 2.1 time: 0.138076 Aug 05 07:19:46.026110 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 286/564] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:45 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:47.052243 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dda2394a-560a-4ee9-8d8e-b22f892f86ff tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:47.052827 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dda2394a-560a-4ee9-8d8e-b22f892f86ff tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:47.060475 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dda2394a-560a-4ee9-8d8e-b22f892f86ff tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:47.061007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dda2394a-560a-4ee9-8d8e-b22f892f86ff tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:47.061519 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dda2394a-560a-4ee9-8d8e-b22f892f86ff tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:47.062165 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dda2394a-560a-4ee9-8d8e-b22f892f86ff tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:47.062620 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dda2394a-560a-4ee9-8d8e-b22f892f86ff tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:47.063044 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dda2394a-560a-4ee9-8d8e-b22f892f86ff tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:47.079115 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-dda2394a-560a-4ee9-8d8e-b22f892f86ff tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dda2394a-560a-4ee9-8d8e-b22f892f86ff tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 HTTP/1.1 Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:19:47.080929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:19:47.083189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:19:47.083189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:19:47.083189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:19:47.083189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:19:47.083189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:19:47.083189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:19:47.083189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:19:47.083189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:19:47.083189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:19:47.083189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:19:47.083189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:19:47.083189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '03c3c22d-3c48-4d1b-8ee9-29c1e3268147'} Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:19:47.083995 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:19:47.085786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:19:47.087572 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dda2394a-560a-4ee9-8d8e-b22f892f86ff tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 404 to user: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:19:47.087572 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-dda2394a-560a-4ee9-8d8e-b22f892f86ff tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 404 len: 111 microversion: 2.1 time: 0.035521 Aug 05 07:19:47.087572 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 279/565] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:47 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:19:47.093275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-aa0452c5-5d67-4c36-9543-066b1fb1bab5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '.version_select at 0x7f4963f55c10>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:47.118852 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-aa0452c5-5d67-4c36-9543-066b1fb1bab5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980436844" status: 202 len: 0 microversion: 2.1 time: 0.029486 Aug 05 07:19:47.119870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 287/566] 10.222.0.27 () {58 vars in 1221 bytes} [Fri Aug 5 07:19:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980436844 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:19:47.877829 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c093cdc7-f724-4dc8-b627-15c9ba31b653 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: .version_select at 0x7f49705cfc10>, body: {"keypair": {"name": "tempest-keypair-2070060702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXqPR7oaPtOPfRypHFrBhOr1Y/ziY2Sw9GaAOqxyEh5V0GIGAruYEdpsVZ+8RPXeXlwqXS6+ubKTlcmXMD1jIw9aZrqdECC9DBGd0Xhdhh17aeLA/MSpGh5EfOBGVFM2A=="}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:19:47.895519 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-c093cdc7-f724-4dc8-b627-15c9ba31b653 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for project 61bf4a49abd8479f895e68d4954412b2. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:19:47.900053 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-c093cdc7-f724-4dc8-b627-15c9ba31b653 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for user 096d0da1a0bc401c95bfbb8fc150a27b and project 61bf4a49abd8479f895e68d4954412b2. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:19:47.926179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c093cdc7-f724-4dc8-b627-15c9ba31b653 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056776 Aug 05 07:19:47.927158 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 280/567] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 5 07:19:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:19:49.354557 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2118042303", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "470083bd-345d-480f-9634-dd509ffd0df2"}], "security_groups": [{"name": "tempest-securitygroup--63286789"}], "key_name": "tempest-keypair-2070060702", "user_data": "}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:19:49.483035 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] validate_networks() for [('470083bd-345d-480f-9634-dd509ffd0df2', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:19:49.691153 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:49.963573 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:19:49.964240 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:19:49.964800 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:19:49.965335 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:19:49.966047 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:19:49.982112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:49.982757 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:49.983195 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:49.984050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:49.984569 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:49.985340 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:50.020778 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for project 61bf4a49abd8479f895e68d4954412b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:19:50.027896 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for user 096d0da1a0bc401c95bfbb8fc150a27b and project 61bf4a49abd8479f895e68d4954412b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:19:50.050276 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:19:50.055195 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:19:50.131068 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-496ca292-0d81-4043-88a9-54f7a55c724b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.784181 Aug 05 07:19:50.131846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 288/568] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:19:49 2022] POST /compute/v2.1/servers => generated 400 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:19:50.148673 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f3eead43-e29c-4d1b-bd14-0e32c5f5cdae tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:50.149862 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f3eead43-e29c-4d1b-bd14-0e32c5f5cdae tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:50.225219 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f3eead43-e29c-4d1b-bd14-0e32c5f5cdae tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:50.233396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f3eead43-e29c-4d1b-bd14-0e32c5f5cdae tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1242 microversion: 2.1 time: 0.092817 Aug 05 07:19:50.233989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 281/569] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:50 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:51.260090 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5fedf55a-ade7-447f-9d0d-6181ebcc5be5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:51.261250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5fedf55a-ade7-447f-9d0d-6181ebcc5be5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:51.272453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5fedf55a-ade7-447f-9d0d-6181ebcc5be5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:51.272937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5fedf55a-ade7-447f-9d0d-6181ebcc5be5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:51.273412 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5fedf55a-ade7-447f-9d0d-6181ebcc5be5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:51.274125 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5fedf55a-ade7-447f-9d0d-6181ebcc5be5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:51.274572 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5fedf55a-ade7-447f-9d0d-6181ebcc5be5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:51.274988 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5fedf55a-ade7-447f-9d0d-6181ebcc5be5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:51.360471 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5fedf55a-ade7-447f-9d0d-6181ebcc5be5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:51.369086 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5fedf55a-ade7-447f-9d0d-6181ebcc5be5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1294 microversion: 2.1 time: 0.117278 Aug 05 07:19:51.373320 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 289/570] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:51 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:52.392201 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-86fdff79-3eaf-42f1-92c2-0ae9b2b6f0b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:52.393907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-86fdff79-3eaf-42f1-92c2-0ae9b2b6f0b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:52.402135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86fdff79-3eaf-42f1-92c2-0ae9b2b6f0b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:52.402840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86fdff79-3eaf-42f1-92c2-0ae9b2b6f0b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:52.403740 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86fdff79-3eaf-42f1-92c2-0ae9b2b6f0b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:52.404813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86fdff79-3eaf-42f1-92c2-0ae9b2b6f0b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:52.405592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86fdff79-3eaf-42f1-92c2-0ae9b2b6f0b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:52.406339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86fdff79-3eaf-42f1-92c2-0ae9b2b6f0b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:52.566907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-86fdff79-3eaf-42f1-92c2-0ae9b2b6f0b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:52.585628 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-86fdff79-3eaf-42f1-92c2-0ae9b2b6f0b0 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1366 microversion: 2.1 time: 0.198904 Aug 05 07:19:52.589314 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 282/571] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:52 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:53.089745 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-5d05fd8e-242f-4630-b0ac-19aba30ed04f req-51bfaea0-9e81-4efd-9af3-6fb0b00f8b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "001d9229-32a3-4aa2-9e7d-c4d306c30d49", "tag": "e676ac49-a459-400f-a384-382ed69aec25"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:19:53.105542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-5d05fd8e-242f-4630-b0ac-19aba30ed04f req-51bfaea0-9e81-4efd-9af3-6fb0b00f8b4d service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:53.107787 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-5d05fd8e-242f-4630-b0ac-19aba30ed04f req-51bfaea0-9e81-4efd-9af3-6fb0b00f8b4d service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:53.108536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-5d05fd8e-242f-4630-b0ac-19aba30ed04f req-51bfaea0-9e81-4efd-9af3-6fb0b00f8b4d service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:53.124729 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-5d05fd8e-242f-4630-b0ac-19aba30ed04f req-51bfaea0-9e81-4efd-9af3-6fb0b00f8b4d service nova] Creating event network-changed:e676ac49-a459-400f-a384-382ed69aec25 for instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 on hv-cinder-85200 Aug 05 07:19:53.132986 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-5d05fd8e-242f-4630-b0ac-19aba30ed04f req-51bfaea0-9e81-4efd-9af3-6fb0b00f8b4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048093 Aug 05 07:19:53.133945 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 290/572] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:19:53.621467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-80176464-3c18-4969-983c-23d63de4ae8c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:53.622477 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-80176464-3c18-4969-983c-23d63de4ae8c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:53.631075 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80176464-3c18-4969-983c-23d63de4ae8c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:53.631729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80176464-3c18-4969-983c-23d63de4ae8c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:53.632268 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80176464-3c18-4969-983c-23d63de4ae8c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:53.633261 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80176464-3c18-4969-983c-23d63de4ae8c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:53.633769 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80176464-3c18-4969-983c-23d63de4ae8c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:53.634312 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80176464-3c18-4969-983c-23d63de4ae8c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:53.829655 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-80176464-3c18-4969-983c-23d63de4ae8c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:53.841812 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-80176464-3c18-4969-983c-23d63de4ae8c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1366 microversion: 2.1 time: 0.224547 Aug 05 07:19:53.842595 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 283/573] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:53 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:54.868940 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4ed57a1b-0df3-466e-a23a-f6275e57c417 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:54.869626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4ed57a1b-0df3-466e-a23a-f6275e57c417 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:54.877559 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4ed57a1b-0df3-466e-a23a-f6275e57c417 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:54.878067 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4ed57a1b-0df3-466e-a23a-f6275e57c417 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:54.878501 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4ed57a1b-0df3-466e-a23a-f6275e57c417 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:54.879244 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4ed57a1b-0df3-466e-a23a-f6275e57c417 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:54.879697 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4ed57a1b-0df3-466e-a23a-f6275e57c417 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:54.880123 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4ed57a1b-0df3-466e-a23a-f6275e57c417 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:55.068922 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4ed57a1b-0df3-466e-a23a-f6275e57c417 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:55.078350 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4ed57a1b-0df3-466e-a23a-f6275e57c417 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1366 microversion: 2.1 time: 0.213847 Aug 05 07:19:55.079158 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 291/574] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:54 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:56.104117 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-723bbeb9-fa68-4019-be73-7b089349ba9f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:56.104843 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-723bbeb9-fa68-4019-be73-7b089349ba9f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:56.112777 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-723bbeb9-fa68-4019-be73-7b089349ba9f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:56.113299 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-723bbeb9-fa68-4019-be73-7b089349ba9f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:56.113741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-723bbeb9-fa68-4019-be73-7b089349ba9f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:56.114453 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-723bbeb9-fa68-4019-be73-7b089349ba9f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:56.114908 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-723bbeb9-fa68-4019-be73-7b089349ba9f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:56.115352 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-723bbeb9-fa68-4019-be73-7b089349ba9f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:56.291571 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-723bbeb9-fa68-4019-be73-7b089349ba9f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:56.300294 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-723bbeb9-fa68-4019-be73-7b089349ba9f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1366 microversion: 2.1 time: 0.204094 Aug 05 07:19:56.300923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 284/575] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:56 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:57.326060 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ee5c8119-da8c-4f7c-8cec-bd571a0fe6a8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:57.327273 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ee5c8119-da8c-4f7c-8cec-bd571a0fe6a8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:57.339251 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee5c8119-da8c-4f7c-8cec-bd571a0fe6a8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:57.340127 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee5c8119-da8c-4f7c-8cec-bd571a0fe6a8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:57.340932 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee5c8119-da8c-4f7c-8cec-bd571a0fe6a8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:57.342220 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee5c8119-da8c-4f7c-8cec-bd571a0fe6a8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:57.343019 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee5c8119-da8c-4f7c-8cec-bd571a0fe6a8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:57.343846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee5c8119-da8c-4f7c-8cec-bd571a0fe6a8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:57.524211 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ee5c8119-da8c-4f7c-8cec-bd571a0fe6a8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:57.533010 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ee5c8119-da8c-4f7c-8cec-bd571a0fe6a8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1366 microversion: 2.1 time: 0.213912 Aug 05 07:19:57.533696 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 292/576] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:57 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:58.555333 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-568ae6da-6471-43b4-a079-fe1758e42752 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:58.555958 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-568ae6da-6471-43b4-a079-fe1758e42752 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:58.563353 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-568ae6da-6471-43b4-a079-fe1758e42752 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:58.563843 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-568ae6da-6471-43b4-a079-fe1758e42752 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:58.564276 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-568ae6da-6471-43b4-a079-fe1758e42752 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:58.565049 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-568ae6da-6471-43b4-a079-fe1758e42752 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:58.565504 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-568ae6da-6471-43b4-a079-fe1758e42752 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:58.565923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-568ae6da-6471-43b4-a079-fe1758e42752 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:58.717412 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-568ae6da-6471-43b4-a079-fe1758e42752 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:58.725545 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-568ae6da-6471-43b4-a079-fe1758e42752 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1366 microversion: 2.1 time: 0.174343 Aug 05 07:19:58.726138 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 285/577] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:58 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:19:59.747950 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8bd2dc49-b6d1-4cd7-84ed-44f84b121b16 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:19:59.748839 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8bd2dc49-b6d1-4cd7-84ed-44f84b121b16 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:19:59.758937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8bd2dc49-b6d1-4cd7-84ed-44f84b121b16 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:59.759615 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8bd2dc49-b6d1-4cd7-84ed-44f84b121b16 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:59.760180 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8bd2dc49-b6d1-4cd7-84ed-44f84b121b16 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:59.761192 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8bd2dc49-b6d1-4cd7-84ed-44f84b121b16 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:19:59.762108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8bd2dc49-b6d1-4cd7-84ed-44f84b121b16 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:19:59.762794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8bd2dc49-b6d1-4cd7-84ed-44f84b121b16 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:19:59.915402 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-8bd2dc49-b6d1-4cd7-84ed-44f84b121b16 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:19:59.923590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8bd2dc49-b6d1-4cd7-84ed-44f84b121b16 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1366 microversion: 2.1 time: 0.180296 Aug 05 07:19:59.924192 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 293/578] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:19:59 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:00.949176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-295e1e79-3656-4f33-8490-388574d0e65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:00.950513 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-295e1e79-3656-4f33-8490-388574d0e65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:00.958629 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:00.967129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-295e1e79-3656-4f33-8490-388574d0e65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:00.968139 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-295e1e79-3656-4f33-8490-388574d0e65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:00.969046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-295e1e79-3656-4f33-8490-388574d0e65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:00.970408 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-295e1e79-3656-4f33-8490-388574d0e65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:00.971345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-295e1e79-3656-4f33-8490-388574d0e65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:00.972256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-295e1e79-3656-4f33-8490-388574d0e65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:01.073789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:01.077112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=6 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:01.173824 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-10af6702-7230-409f-91e9-979d1c09fe32 req-cf57bc01-0249-4648-9046-28a1358daded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001d9229-32a3-4aa2-9e7d-c4d306c30d49", "name": "network-vif-plugged", "status": "completed", "tag": "e676ac49-a459-400f-a384-382ed69aec25"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:01.175551 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-295e1e79-3656-4f33-8490-388574d0e65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:01.190041 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-10af6702-7230-409f-91e9-979d1c09fe32 req-cf57bc01-0249-4648-9046-28a1358daded service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:01.190373 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-295e1e79-3656-4f33-8490-388574d0e65b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1366 microversion: 2.1 time: 0.246453 Aug 05 07:20:01.190641 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-10af6702-7230-409f-91e9-979d1c09fe32 req-cf57bc01-0249-4648-9046-28a1358daded service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:01.191037 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 286/579] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:00 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:01.191210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-10af6702-7230-409f-91e9-979d1c09fe32 req-cf57bc01-0249-4648-9046-28a1358daded service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:01.205108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-10af6702-7230-409f-91e9-979d1c09fe32 req-cf57bc01-0249-4648-9046-28a1358daded service nova] Creating event network-vif-plugged:e676ac49-a459-400f-a384-382ed69aec25 for instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 on hv-cinder-85200 Aug 05 07:20:01.211497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-10af6702-7230-409f-91e9-979d1c09fe32 req-cf57bc01-0249-4648-9046-28a1358daded service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147658 Aug 05 07:20:01.212598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 294/580] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:02.213826 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1726e405-dec4-4bcc-b4ad-d8b13f864fe6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:02.214699 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1726e405-dec4-4bcc-b4ad-d8b13f864fe6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:02.222437 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1726e405-dec4-4bcc-b4ad-d8b13f864fe6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:02.222988 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1726e405-dec4-4bcc-b4ad-d8b13f864fe6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:02.223499 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1726e405-dec4-4bcc-b4ad-d8b13f864fe6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:02.224271 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1726e405-dec4-4bcc-b4ad-d8b13f864fe6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:02.224763 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1726e405-dec4-4bcc-b4ad-d8b13f864fe6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:02.225268 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1726e405-dec4-4bcc-b4ad-d8b13f864fe6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:02.415392 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1726e405-dec4-4bcc-b4ad-d8b13f864fe6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:02.429199 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1726e405-dec4-4bcc-b4ad-d8b13f864fe6 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1366 microversion: 2.1 time: 0.219360 Aug 05 07:20:02.430239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 287/581] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:02 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:03.464427 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1bd0c965-5e03-4f89-a42b-63eb4e840745 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:03.465106 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1bd0c965-5e03-4f89-a42b-63eb4e840745 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:03.473241 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1bd0c965-5e03-4f89-a42b-63eb4e840745 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:03.473747 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1bd0c965-5e03-4f89-a42b-63eb4e840745 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:03.474329 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1bd0c965-5e03-4f89-a42b-63eb4e840745 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:03.475357 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1bd0c965-5e03-4f89-a42b-63eb4e840745 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:03.475887 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1bd0c965-5e03-4f89-a42b-63eb4e840745 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:03.476311 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1bd0c965-5e03-4f89-a42b-63eb4e840745 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:03.481292 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=73 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:03.657000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1bd0c965-5e03-4f89-a42b-63eb4e840745 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:03.666957 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1bd0c965-5e03-4f89-a42b-63eb4e840745 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1366 microversion: 2.1 time: 0.207775 Aug 05 07:20:03.667630 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 295/582] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:03 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:20:04.689873 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fc6787cf-b2b6-4178-b11e-ae73bc688234 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:04.690443 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fc6787cf-b2b6-4178-b11e-ae73bc688234 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:04.698977 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fc6787cf-b2b6-4178-b11e-ae73bc688234 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:04.699467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fc6787cf-b2b6-4178-b11e-ae73bc688234 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:04.700229 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fc6787cf-b2b6-4178-b11e-ae73bc688234 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:04.700984 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fc6787cf-b2b6-4178-b11e-ae73bc688234 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:04.701443 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fc6787cf-b2b6-4178-b11e-ae73bc688234 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:04.701868 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fc6787cf-b2b6-4178-b11e-ae73bc688234 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:04.848969 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fc6787cf-b2b6-4178-b11e-ae73bc688234 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:04.857529 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fc6787cf-b2b6-4178-b11e-ae73bc688234 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1555 microversion: 2.1 time: 0.172965 Aug 05 07:20:04.858148 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 288/583] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:04 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:04.878952 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c8a15fd1-70e8-4fde-a0a9-4a03727b7115 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:04.879577 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c8a15fd1-70e8-4fde-a0a9-4a03727b7115 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:04.886579 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8a15fd1-70e8-4fde-a0a9-4a03727b7115 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:04.887071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8a15fd1-70e8-4fde-a0a9-4a03727b7115 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:04.887567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8a15fd1-70e8-4fde-a0a9-4a03727b7115 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:04.888278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8a15fd1-70e8-4fde-a0a9-4a03727b7115 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:04.888735 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8a15fd1-70e8-4fde-a0a9-4a03727b7115 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:04.889192 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8a15fd1-70e8-4fde-a0a9-4a03727b7115 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:04.977384 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c8a15fd1-70e8-4fde-a0a9-4a03727b7115 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102719 Aug 05 07:20:04.978129 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 296/584] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 5 07:20:04 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:06.059810 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-92b71c95-5ec1-4c12-8ab6-53de08599b81 req-7e600e74-7d17-4dfd-ba97-93b96b61597c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "001d9229-32a3-4aa2-9e7d-c4d306c30d49", "tag": "e676ac49-a459-400f-a384-382ed69aec25"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:06.070240 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-92b71c95-5ec1-4c12-8ab6-53de08599b81 req-7e600e74-7d17-4dfd-ba97-93b96b61597c service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:06.070800 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-92b71c95-5ec1-4c12-8ab6-53de08599b81 req-7e600e74-7d17-4dfd-ba97-93b96b61597c service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:06.071287 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-92b71c95-5ec1-4c12-8ab6-53de08599b81 req-7e600e74-7d17-4dfd-ba97-93b96b61597c service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:06.083421 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-92b71c95-5ec1-4c12-8ab6-53de08599b81 req-7e600e74-7d17-4dfd-ba97-93b96b61597c service nova] Creating event network-changed:e676ac49-a459-400f-a384-382ed69aec25 for instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 on hv-cinder-85200 Aug 05 07:20:06.088828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-92b71c95-5ec1-4c12-8ab6-53de08599b81 req-7e600e74-7d17-4dfd-ba97-93b96b61597c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033124 Aug 05 07:20:06.089808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 289/585] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:18.993544 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:18.994342 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=9 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:18.999252 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-fcf434a0-7c08-4af5-8d2f-1ea17b8965c1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:18.999999 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-fcf434a0-7c08-4af5-8d2f-1ea17b8965c1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:19.012283 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fcf434a0-7c08-4af5-8d2f-1ea17b8965c1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:19.012283 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fcf434a0-7c08-4af5-8d2f-1ea17b8965c1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:19.012283 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fcf434a0-7c08-4af5-8d2f-1ea17b8965c1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:19.012283 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fcf434a0-7c08-4af5-8d2f-1ea17b8965c1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:19.013189 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fcf434a0-7c08-4af5-8d2f-1ea17b8965c1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:19.013189 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fcf434a0-7c08-4af5-8d2f-1ea17b8965c1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:19.146638 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-fcf434a0-7c08-4af5-8d2f-1ea17b8965c1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lazy-loading 'services' on Instance uuid 93d20686-267a-4bf7-b36b-7a248b0c3d8d {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:20:19.268985 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-fcf434a0-7c08-4af5-8d2f-1ea17b8965c1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments/7e0c3d1b-f220-4931-9b0f-8b2101b36aed" status: 202 len: 0 microversion: 2.1 time: 0.276737 Aug 05 07:20:19.269580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 297/586] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 5 07:20:18 2022] DELETE /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments/7e0c3d1b-f220-4931-9b0f-8b2101b36aed => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:20:19.277879 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:19.278913 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:19.283739 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d9511ab6-e9c6-4d3c-8c95-8f1c20baec75 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:19.286321 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d9511ab6-e9c6-4d3c-8c95-8f1c20baec75 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:19.295359 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9511ab6-e9c6-4d3c-8c95-8f1c20baec75 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:19.296219 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9511ab6-e9c6-4d3c-8c95-8f1c20baec75 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:19.296749 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9511ab6-e9c6-4d3c-8c95-8f1c20baec75 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:19.297690 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9511ab6-e9c6-4d3c-8c95-8f1c20baec75 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:19.298142 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9511ab6-e9c6-4d3c-8c95-8f1c20baec75 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:19.298563 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9511ab6-e9c6-4d3c-8c95-8f1c20baec75 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:19.332262 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d9511ab6-e9c6-4d3c-8c95-8f1c20baec75 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056082 Aug 05 07:20:19.332836 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 290/587] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:20:19 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:20:20.347307 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-60ff90f8-fd1a-476d-b9f4-6419a22331a8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:20.351218 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-60ff90f8-fd1a-476d-b9f4-6419a22331a8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:20.358862 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-60ff90f8-fd1a-476d-b9f4-6419a22331a8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:20.359363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-60ff90f8-fd1a-476d-b9f4-6419a22331a8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:20.359803 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-60ff90f8-fd1a-476d-b9f4-6419a22331a8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:20.360554 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-60ff90f8-fd1a-476d-b9f4-6419a22331a8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:20.361040 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-60ff90f8-fd1a-476d-b9f4-6419a22331a8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:20.361468 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-60ff90f8-fd1a-476d-b9f4-6419a22331a8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:20.395536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-60ff90f8-fd1a-476d-b9f4-6419a22331a8 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054575 Aug 05 07:20:20.396644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 298/588] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:20:20 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:21.408911 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9a719cf9-35c2-4ce7-b4be-340c270986ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:21.411540 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9a719cf9-35c2-4ce7-b4be-340c270986ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:21.418980 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a719cf9-35c2-4ce7-b4be-340c270986ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:21.419452 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a719cf9-35c2-4ce7-b4be-340c270986ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:21.419882 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a719cf9-35c2-4ce7-b4be-340c270986ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:21.420566 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a719cf9-35c2-4ce7-b4be-340c270986ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:21.421163 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a719cf9-35c2-4ce7-b4be-340c270986ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:21.421593 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a719cf9-35c2-4ce7-b4be-340c270986ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:21.451546 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9a719cf9-35c2-4ce7-b4be-340c270986ea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047231 Aug 05 07:20:21.452118 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 291/589] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:20:21 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 07:20:21.542458 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4f7f855b-f00f-43a9-9839-e40c3a871fb2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:21.543015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4f7f855b-f00f-43a9-9839-e40c3a871fb2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:21.549792 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f7f855b-f00f-43a9-9839-e40c3a871fb2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:21.550277 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f7f855b-f00f-43a9-9839-e40c3a871fb2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:21.550720 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f7f855b-f00f-43a9-9839-e40c3a871fb2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:21.551414 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f7f855b-f00f-43a9-9839-e40c3a871fb2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:21.551866 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f7f855b-f00f-43a9-9839-e40c3a871fb2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:21.552312 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f7f855b-f00f-43a9-9839-e40c3a871fb2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:21.581777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4f7f855b-f00f-43a9-9839-e40c3a871fb2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Going to try to terminate instance {{(pid=117894) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:20:21.669214 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4f7f855b-f00f-43a9-9839-e40c3a871fb2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 204 len: 0 microversion: 2.1 time: 0.130635 Aug 05 07:20:21.669823 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 299/590] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:20:21 2022] DELETE /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 07:20:21.678803 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-85b44479-8601-4558-b96e-da15cc8c6711 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:21.679445 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-85b44479-8601-4558-b96e-da15cc8c6711 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:21.685911 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85b44479-8601-4558-b96e-da15cc8c6711 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:21.686401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85b44479-8601-4558-b96e-da15cc8c6711 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:21.686896 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85b44479-8601-4558-b96e-da15cc8c6711 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:21.688558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85b44479-8601-4558-b96e-da15cc8c6711 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:21.689044 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85b44479-8601-4558-b96e-da15cc8c6711 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:21.689466 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85b44479-8601-4558-b96e-da15cc8c6711 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:21.844177 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-85b44479-8601-4558-b96e-da15cc8c6711 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:21.852410 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-85b44479-8601-4558-b96e-da15cc8c6711 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1691 microversion: 2.1 time: 0.178081 Aug 05 07:20:21.853095 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 292/591] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:21 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:20:22.875000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3b6e0877-1492-4a8b-924a-9481ed37ff99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:22.875710 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3b6e0877-1492-4a8b-924a-9481ed37ff99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:22.883438 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3b6e0877-1492-4a8b-924a-9481ed37ff99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:22.883918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3b6e0877-1492-4a8b-924a-9481ed37ff99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:22.884408 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3b6e0877-1492-4a8b-924a-9481ed37ff99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:22.885249 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3b6e0877-1492-4a8b-924a-9481ed37ff99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:22.885744 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3b6e0877-1492-4a8b-924a-9481ed37ff99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:22.886171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3b6e0877-1492-4a8b-924a-9481ed37ff99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:23.030405 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3b6e0877-1492-4a8b-924a-9481ed37ff99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:23.038779 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3b6e0877-1492-4a8b-924a-9481ed37ff99 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1691 microversion: 2.1 time: 0.168315 Aug 05 07:20:23.039363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 300/592] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:22 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:24.060583 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-799c3535-eb9b-4dac-bcf2-bbeac20bcb60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:24.061233 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-799c3535-eb9b-4dac-bcf2-bbeac20bcb60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:24.068435 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-799c3535-eb9b-4dac-bcf2-bbeac20bcb60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:24.068954 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-799c3535-eb9b-4dac-bcf2-bbeac20bcb60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:24.069392 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-799c3535-eb9b-4dac-bcf2-bbeac20bcb60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:24.070101 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-799c3535-eb9b-4dac-bcf2-bbeac20bcb60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:24.070557 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-799c3535-eb9b-4dac-bcf2-bbeac20bcb60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:24.071128 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-799c3535-eb9b-4dac-bcf2-bbeac20bcb60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:24.234346 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-799c3535-eb9b-4dac-bcf2-bbeac20bcb60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:24.243214 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-799c3535-eb9b-4dac-bcf2-bbeac20bcb60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1691 microversion: 2.1 time: 0.186687 Aug 05 07:20:24.243821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 293/593] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:24 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1691 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:25.278635 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-64859c73-d18e-4452-a735-f73315aca639 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:25.279275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-64859c73-d18e-4452-a735-f73315aca639 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:25.286711 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-64859c73-d18e-4452-a735-f73315aca639 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:25.287206 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-64859c73-d18e-4452-a735-f73315aca639 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:25.287648 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-64859c73-d18e-4452-a735-f73315aca639 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:25.288354 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-64859c73-d18e-4452-a735-f73315aca639 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:25.288797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-64859c73-d18e-4452-a735-f73315aca639 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:25.289259 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-64859c73-d18e-4452-a735-f73315aca639 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:25.437410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-64859c73-d18e-4452-a735-f73315aca639 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:25.445498 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-64859c73-d18e-4452-a735-f73315aca639 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1691 microversion: 2.1 time: 0.171034 Aug 05 07:20:25.446097 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 301/594] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:25 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:26.469834 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7e729593-3a7f-4349-996b-557fd98e9f60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:26.470408 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7e729593-3a7f-4349-996b-557fd98e9f60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:26.477484 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e729593-3a7f-4349-996b-557fd98e9f60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:26.478002 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e729593-3a7f-4349-996b-557fd98e9f60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:26.478406 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e729593-3a7f-4349-996b-557fd98e9f60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:26.479105 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e729593-3a7f-4349-996b-557fd98e9f60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:26.479549 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e729593-3a7f-4349-996b-557fd98e9f60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:26.479960 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e729593-3a7f-4349-996b-557fd98e9f60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:26.546300 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7e729593-3a7f-4349-996b-557fd98e9f60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:26.554951 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7e729593-3a7f-4349-996b-557fd98e9f60 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1623 microversion: 2.1 time: 0.089236 Aug 05 07:20:26.555541 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 294/595] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:26 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1623 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:27.012942 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-d34d938e-a5f6-44e7-9554-c5f12208efd7 req-c5b8e6b7-8d29-4c0b-8145-4afc185740ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d20686-267a-4bf7-b36b-7a248b0c3d8d", "name": "network-vif-deleted", "tag": "08518c24-70ef-4c17-a240-418e5eae2128"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:27.024449 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-d34d938e-a5f6-44e7-9554-c5f12208efd7 req-c5b8e6b7-8d29-4c0b-8145-4afc185740ba service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:27.024823 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-d34d938e-a5f6-44e7-9554-c5f12208efd7 req-c5b8e6b7-8d29-4c0b-8145-4afc185740ba service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:27.025270 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-d34d938e-a5f6-44e7-9554-c5f12208efd7 req-c5b8e6b7-8d29-4c0b-8145-4afc185740ba service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:27.037966 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-d34d938e-a5f6-44e7-9554-c5f12208efd7 req-c5b8e6b7-8d29-4c0b-8145-4afc185740ba service nova] Creating event network-vif-deleted:08518c24-70ef-4c17-a240-418e5eae2128 for instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d on hv-cinder-85200 Aug 05 07:20:27.043177 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-d34d938e-a5f6-44e7-9554-c5f12208efd7 req-c5b8e6b7-8d29-4c0b-8145-4afc185740ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034097 Aug 05 07:20:27.044278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 302/596] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:27.576653 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:27.578875 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:27.584198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:27.584756 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:27.585303 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:27.586183 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:27.587106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:27.587106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:27.620294 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:27.621138 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:27.621577 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:27.622045 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lazy-loading 'fault' on Instance uuid 93d20686-267a-4bf7-b36b-7a248b0c3d8d {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:20:27.670575 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:27.678538 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f78cecaa-a08c-4fbb-8a64-2cdf00c5e100 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 200 len: 1335 microversion: 2.1 time: 0.106293 Aug 05 07:20:27.679122 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 295/597] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:27 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 1335 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:28.700618 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7d5b0b52-40db-4f75-831d-18f06fb74b22 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:28.701355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7d5b0b52-40db-4f75-831d-18f06fb74b22 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: 93d20686-267a-4bf7-b36b-7a248b0c3d8d] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:28.707888 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d5b0b52-40db-4f75-831d-18f06fb74b22 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:28.708364 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d5b0b52-40db-4f75-831d-18f06fb74b22 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:28.708787 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d5b0b52-40db-4f75-831d-18f06fb74b22 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:28.709510 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d5b0b52-40db-4f75-831d-18f06fb74b22 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:28.709952 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d5b0b52-40db-4f75-831d-18f06fb74b22 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:28.710368 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d5b0b52-40db-4f75-831d-18f06fb74b22 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:28.724921 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-7d5b0b52-40db-4f75-831d-18f06fb74b22 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] HTTP exception thrown: Instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d could not be found. Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7d5b0b52-40db-4f75-831d-18f06fb74b22 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Request method failure captured: Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d HTTP/1.1 Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MM-EQUpnzTV_TuaBii4EnDtucJf3DBJQuckc_cz-EahkMlyKuaPdeRlNPw5xVtsl6C2UBh_Yoa08ue84u1Lxb6YzWInBS__DjPsZZfDUKm9pQ3Ro_hNX8NmosRUVx0DbFBQGMhI8X49NbxrPMBizm2j_rmdwFPmQfNSyM6KMFZP8bo Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: fe39edf907ff48518759474a800b949d Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:20:28.726591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:20:28.728242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe39edf907ff48518759474a800b949d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe39edf907ff48518759474a800b949d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe39edf907ff48518759474a800b949d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe39edf907ff48518759474a800b949d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:20:28.728242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:20:28.728242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: fe39edf907ff48518759474a800b949d Aug 05 07:20:28.728242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:20:28.728242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-ServerRescueNegativeTestJSON-619170576-project Aug 05 07:20:28.728242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:20:28.728242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:20:28.728242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 2ce8bf4f0ab64010b3855193f55971d2 Aug 05 07:20:28.728242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-ServerRescueNegativeTestJSON-619170576-project Aug 05 07:20:28.728242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:20:28.728242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d could not be found. Aug 05 07:20:28.728242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': '93d20686-267a-4bf7-b36b-7a248b0c3d8d'} Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d could not be found. Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:20:28.729135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d could not be found. Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d could not be found. Aug 05 07:20:28.730593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:28.732288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7d5b0b52-40db-4f75-831d-18f06fb74b22 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Returning 404 to user: Instance 93d20686-267a-4bf7-b36b-7a248b0c3d8d could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:20:28.732288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7d5b0b52-40db-4f75-831d-18f06fb74b22 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d" status: 404 len: 111 microversion: 2.1 time: 0.032164 Aug 05 07:20:28.732288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 303/598] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:28 2022] GET /compute/v2.1/servers/93d20686-267a-4bf7-b36b-7a248b0c3d8d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:20:28.737276 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-785fecde-e940-4cc4-b417-fec7544862a4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '.version_select at 0x7f497068b820>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:28.755905 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-131881aa-963b-4db7-8c13-1390ef36fa5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:28.756415 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-131881aa-963b-4db7-8c13-1390ef36fa5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:28.760382 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-785fecde-e940-4cc4-b417-fec7544862a4 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517680783" status: 202 len: 0 microversion: 2.1 time: 0.027094 Aug 05 07:20:28.761234 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 296/599] 10.222.0.27 () {58 vars in 1221 bytes} [Fri Aug 5 07:20:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517680783 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:20:28.763068 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-131881aa-963b-4db7-8c13-1390ef36fa5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:28.763533 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-131881aa-963b-4db7-8c13-1390ef36fa5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:28.763922 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-131881aa-963b-4db7-8c13-1390ef36fa5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:28.764675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-131881aa-963b-4db7-8c13-1390ef36fa5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:28.765127 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-131881aa-963b-4db7-8c13-1390ef36fa5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:28.765539 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-131881aa-963b-4db7-8c13-1390ef36fa5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:28.797772 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-131881aa-963b-4db7-8c13-1390ef36fa5f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/os-volume_attachments/a88b1660-5fc3-4799-be91-17e8ef965272" status: 200 len: 194 microversion: 2.20 time: 0.045766 Aug 05 07:20:28.798410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 304/600] 10.222.0.27 () {60 vars in 1454 bytes} [Fri Aug 5 07:20:28 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/os-volume_attachments/a88b1660-5fc3-4799-be91-17e8ef965272 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:20:28.871236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3071f632-aacd-42b2-9328-82addbbbd0fb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:28.871986 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3071f632-aacd-42b2-9328-82addbbbd0fb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:28.879235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3071f632-aacd-42b2-9328-82addbbbd0fb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:28.879746 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3071f632-aacd-42b2-9328-82addbbbd0fb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:28.880161 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3071f632-aacd-42b2-9328-82addbbbd0fb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:28.880871 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3071f632-aacd-42b2-9328-82addbbbd0fb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:28.881353 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3071f632-aacd-42b2-9328-82addbbbd0fb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:28.881761 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3071f632-aacd-42b2-9328-82addbbbd0fb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:28.973177 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-3071f632-aacd-42b2-9328-82addbbbd0fb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lazy-loading 'services' on Instance uuid f664511a-28db-4ff6-90e9-7e2db58e94e2 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:20:29.058354 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3071f632-aacd-42b2-9328-82addbbbd0fb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/os-volume_attachments/a88b1660-5fc3-4799-be91-17e8ef965272" status: 202 len: 0 microversion: 2.20 time: 0.192008 Aug 05 07:20:29.058981 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 297/601] 10.222.0.27 () {60 vars in 1457 bytes} [Fri Aug 5 07:20:28 2022] DELETE /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/os-volume_attachments/a88b1660-5fc3-4799-be91-17e8ef965272 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:20:29.071494 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d3cc53d8-abae-49f8-865a-7096a5d7bfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:29.075094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d3cc53d8-abae-49f8-865a-7096a5d7bfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:29.086186 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d3cc53d8-abae-49f8-865a-7096a5d7bfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:29.087138 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d3cc53d8-abae-49f8-865a-7096a5d7bfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:29.087956 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d3cc53d8-abae-49f8-865a-7096a5d7bfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:29.089295 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d3cc53d8-abae-49f8-865a-7096a5d7bfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:29.090015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d3cc53d8-abae-49f8-865a-7096a5d7bfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:29.090444 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d3cc53d8-abae-49f8-865a-7096a5d7bfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:29.123288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d3cc53d8-abae-49f8-865a-7096a5d7bfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058988 Aug 05 07:20:29.123855 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 305/602] 10.222.0.27 () {60 vars in 1343 bytes} [Fri Aug 5 07:20:29 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:20:30.140492 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f2e842cf-2f36-4b7a-b3fa-bca2bda2a0bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:30.143249 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f2e842cf-2f36-4b7a-b3fa-bca2bda2a0bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:30.149856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f2e842cf-2f36-4b7a-b3fa-bca2bda2a0bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:30.150337 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f2e842cf-2f36-4b7a-b3fa-bca2bda2a0bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:30.150775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f2e842cf-2f36-4b7a-b3fa-bca2bda2a0bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:30.151455 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f2e842cf-2f36-4b7a-b3fa-bca2bda2a0bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:30.151890 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f2e842cf-2f36-4b7a-b3fa-bca2bda2a0bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:30.152317 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f2e842cf-2f36-4b7a-b3fa-bca2bda2a0bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:30.184220 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f2e842cf-2f36-4b7a-b3fa-bca2bda2a0bb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048766 Aug 05 07:20:30.184814 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 298/603] 10.222.0.27 () {60 vars in 1343 bytes} [Fri Aug 5 07:20:30 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:20:30.262264 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8a56843a-15ae-4c81-9ee4-42303117b591 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:30.262840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8a56843a-15ae-4c81-9ee4-42303117b591 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:30.273865 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8a56843a-15ae-4c81-9ee4-42303117b591 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:30.274345 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8a56843a-15ae-4c81-9ee4-42303117b591 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:30.274777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8a56843a-15ae-4c81-9ee4-42303117b591 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:30.275472 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8a56843a-15ae-4c81-9ee4-42303117b591 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:30.275913 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8a56843a-15ae-4c81-9ee4-42303117b591 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:30.276333 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8a56843a-15ae-4c81-9ee4-42303117b591 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:30.305196 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8a56843a-15ae-4c81-9ee4-42303117b591 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Going to try to terminate instance {{(pid=117894) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:20:30.396887 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8a56843a-15ae-4c81-9ee4-42303117b591 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 204 len: 0 microversion: 2.20 time: 0.137769 Aug 05 07:20:30.397873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 306/604] 10.222.0.27 () {60 vars in 1280 bytes} [Fri Aug 5 07:20:30 2022] DELETE /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 05 07:20:30.406994 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ba5c8227-4818-4d2c-a81c-131514b64969 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:30.407659 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ba5c8227-4818-4d2c-a81c-131514b64969 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:30.414098 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ba5c8227-4818-4d2c-a81c-131514b64969 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:30.414583 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ba5c8227-4818-4d2c-a81c-131514b64969 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:30.415010 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ba5c8227-4818-4d2c-a81c-131514b64969 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:30.415705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ba5c8227-4818-4d2c-a81c-131514b64969 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:30.416149 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ba5c8227-4818-4d2c-a81c-131514b64969 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:30.416565 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ba5c8227-4818-4d2c-a81c-131514b64969 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:30.567414 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ba5c8227-4818-4d2c-a81c-131514b64969 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:30.578821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ba5c8227-4818-4d2c-a81c-131514b64969 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:30.580766 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ba5c8227-4818-4d2c-a81c-131514b64969 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:30.582238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ba5c8227-4818-4d2c-a81c-131514b64969 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.179594 Aug 05 07:20:30.583115 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-830eef37-c055-4783-88c5-8137cacb5b5a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:30.583699 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 299/605] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:30 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:30.583985 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-830eef37-c055-4783-88c5-8137cacb5b5a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:30.598260 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-830eef37-c055-4783-88c5-8137cacb5b5a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:30.598791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-830eef37-c055-4783-88c5-8137cacb5b5a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:30.599360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-830eef37-c055-4783-88c5-8137cacb5b5a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:30.600995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-830eef37-c055-4783-88c5-8137cacb5b5a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:30.601567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-830eef37-c055-4783-88c5-8137cacb5b5a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:30.602377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-830eef37-c055-4783-88c5-8137cacb5b5a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:30.631609 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-830eef37-c055-4783-88c5-8137cacb5b5a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Going to try to terminate instance {{(pid=117894) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:20:30.734706 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-830eef37-c055-4783-88c5-8137cacb5b5a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 204 len: 0 microversion: 2.1 time: 0.158425 Aug 05 07:20:30.735307 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 307/606] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:20:30 2022] DELETE /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:20:30.743502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a80e742d-b7fd-426d-b0d8-628677f85cd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:30.744090 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a80e742d-b7fd-426d-b0d8-628677f85cd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:30.750550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a80e742d-b7fd-426d-b0d8-628677f85cd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:30.751031 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a80e742d-b7fd-426d-b0d8-628677f85cd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:30.751457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a80e742d-b7fd-426d-b0d8-628677f85cd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:30.752148 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a80e742d-b7fd-426d-b0d8-628677f85cd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:30.752591 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a80e742d-b7fd-426d-b0d8-628677f85cd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:30.753045 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a80e742d-b7fd-426d-b0d8-628677f85cd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:30.933493 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a80e742d-b7fd-426d-b0d8-628677f85cd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:30.942081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a80e742d-b7fd-426d-b0d8-628677f85cd1 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1575 microversion: 2.1 time: 0.202343 Aug 05 07:20:30.942660 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 300/607] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:30 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:31.620082 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-62e83f8c-115a-418f-ac74-dcfaca9a12ac tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:31.620793 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-62e83f8c-115a-418f-ac74-dcfaca9a12ac tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:31.628120 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-62e83f8c-115a-418f-ac74-dcfaca9a12ac tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:31.628615 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-62e83f8c-115a-418f-ac74-dcfaca9a12ac tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:31.629086 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-62e83f8c-115a-418f-ac74-dcfaca9a12ac tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:31.629795 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-62e83f8c-115a-418f-ac74-dcfaca9a12ac tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:31.630278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-62e83f8c-115a-418f-ac74-dcfaca9a12ac tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:31.630698 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-62e83f8c-115a-418f-ac74-dcfaca9a12ac tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:31.753941 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b3d650c5-f7b4-4525-8b2b-0d57bdcc7f7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:31.754604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b3d650c5-f7b4-4525-8b2b-0d57bdcc7f7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:31.765148 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3d650c5-f7b4-4525-8b2b-0d57bdcc7f7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:31.765853 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3d650c5-f7b4-4525-8b2b-0d57bdcc7f7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:31.766580 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3d650c5-f7b4-4525-8b2b-0d57bdcc7f7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:31.768013 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3d650c5-f7b4-4525-8b2b-0d57bdcc7f7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:31.768940 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3d650c5-f7b4-4525-8b2b-0d57bdcc7f7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:31.769897 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3d650c5-f7b4-4525-8b2b-0d57bdcc7f7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:31.781208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-62e83f8c-115a-418f-ac74-dcfaca9a12ac tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:31.792291 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-62e83f8c-115a-418f-ac74-dcfaca9a12ac tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:31.794758 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-62e83f8c-115a-418f-ac74-dcfaca9a12ac tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:31.796284 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-62e83f8c-115a-418f-ac74-dcfaca9a12ac tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.180647 Aug 05 07:20:31.797861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 308/608] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:31 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:31.821337 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b3d650c5-f7b4-4525-8b2b-0d57bdcc7f7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:20:31.919733 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b3d650c5-f7b4-4525-8b2b-0d57bdcc7f7a tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 204 len: 0 microversion: 2.1 time: 0.171705 Aug 05 07:20:31.920355 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 301/609] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:20:31 2022] DELETE /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 07:20:31.929059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-569d5efc-b2e7-4c21-b547-90e3df75195b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:31.929906 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-569d5efc-b2e7-4c21-b547-90e3df75195b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:31.936423 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-569d5efc-b2e7-4c21-b547-90e3df75195b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:31.936937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-569d5efc-b2e7-4c21-b547-90e3df75195b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:31.937416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-569d5efc-b2e7-4c21-b547-90e3df75195b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:31.938560 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-569d5efc-b2e7-4c21-b547-90e3df75195b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:31.939023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-569d5efc-b2e7-4c21-b547-90e3df75195b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:31.939580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-569d5efc-b2e7-4c21-b547-90e3df75195b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:31.945079 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:31.964373 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6d37b0fb-6cab-489e-adda-e759315da475 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:31.965172 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6d37b0fb-6cab-489e-adda-e759315da475 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:31.972485 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d37b0fb-6cab-489e-adda-e759315da475 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:31.972999 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d37b0fb-6cab-489e-adda-e759315da475 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:31.973434 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d37b0fb-6cab-489e-adda-e759315da475 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:31.974144 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d37b0fb-6cab-489e-adda-e759315da475 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:31.974595 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d37b0fb-6cab-489e-adda-e759315da475 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:31.975016 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d37b0fb-6cab-489e-adda-e759315da475 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:32.128348 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-569d5efc-b2e7-4c21-b547-90e3df75195b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:32.143532 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-569d5efc-b2e7-4c21-b547-90e3df75195b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1508 microversion: 2.1 time: 0.218215 Aug 05 07:20:32.149404 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 309/610] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:31 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:20:32.160933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6d37b0fb-6cab-489e-adda-e759315da475 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:32.169236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6d37b0fb-6cab-489e-adda-e759315da475 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1575 microversion: 2.1 time: 0.209903 Aug 05 07:20:32.170406 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 302/611] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:31 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:20:32.214798 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ad71dc2b-945e-4fad-a9a7-377e5d7836c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:32.217168 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ad71dc2b-945e-4fad-a9a7-377e5d7836c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:32.224104 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad71dc2b-945e-4fad-a9a7-377e5d7836c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:32.224566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad71dc2b-945e-4fad-a9a7-377e5d7836c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:32.225028 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad71dc2b-945e-4fad-a9a7-377e5d7836c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:32.225738 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad71dc2b-945e-4fad-a9a7-377e5d7836c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:32.226178 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad71dc2b-945e-4fad-a9a7-377e5d7836c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:32.226589 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad71dc2b-945e-4fad-a9a7-377e5d7836c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:32.259645 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ad71dc2b-945e-4fad-a9a7-377e5d7836c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049024 Aug 05 07:20:32.260206 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 310/612] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:20:32 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 07:20:32.326842 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-530dd307-2961-48f0-84d1-50db299262e9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:32.327487 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-530dd307-2961-48f0-84d1-50db299262e9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:32.334170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-530dd307-2961-48f0-84d1-50db299262e9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:32.334713 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-530dd307-2961-48f0-84d1-50db299262e9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:32.335124 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-530dd307-2961-48f0-84d1-50db299262e9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:32.335789 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-530dd307-2961-48f0-84d1-50db299262e9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:32.336226 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-530dd307-2961-48f0-84d1-50db299262e9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:32.336634 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-530dd307-2961-48f0-84d1-50db299262e9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:32.368587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-530dd307-2961-48f0-84d1-50db299262e9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:20:32.410842 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:32.458553 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-530dd307-2961-48f0-84d1-50db299262e9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "DELETE /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 204 len: 0 microversion: 2.1 time: 0.135518 Aug 05 07:20:32.459213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 303/613] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:20:32 2022] DELETE /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:20:32.468267 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b3ee4e59-37b1-4282-9b39-4b5ee41dcd36 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:32.469040 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b3ee4e59-37b1-4282-9b39-4b5ee41dcd36 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:32.475633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b3ee4e59-37b1-4282-9b39-4b5ee41dcd36 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:32.476116 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b3ee4e59-37b1-4282-9b39-4b5ee41dcd36 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:32.476560 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b3ee4e59-37b1-4282-9b39-4b5ee41dcd36 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:32.477410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b3ee4e59-37b1-4282-9b39-4b5ee41dcd36 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:32.477860 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b3ee4e59-37b1-4282-9b39-4b5ee41dcd36 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:32.478271 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b3ee4e59-37b1-4282-9b39-4b5ee41dcd36 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:32.673556 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b3ee4e59-37b1-4282-9b39-4b5ee41dcd36 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:32.681866 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b3ee4e59-37b1-4282-9b39-4b5ee41dcd36 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1674 microversion: 2.1 time: 0.217582 Aug 05 07:20:32.682246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 311/614] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:32 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1674 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:32.836559 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-776567fd-47dd-4676-b37b-6a27ee0eaab4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:32.837293 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-776567fd-47dd-4676-b37b-6a27ee0eaab4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:32.844714 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-776567fd-47dd-4676-b37b-6a27ee0eaab4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:32.845412 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-776567fd-47dd-4676-b37b-6a27ee0eaab4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:32.845942 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-776567fd-47dd-4676-b37b-6a27ee0eaab4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:32.846767 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-776567fd-47dd-4676-b37b-6a27ee0eaab4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:32.847313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-776567fd-47dd-4676-b37b-6a27ee0eaab4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:32.847858 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-776567fd-47dd-4676-b37b-6a27ee0eaab4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:33.006158 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-776567fd-47dd-4676-b37b-6a27ee0eaab4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:33.015704 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-776567fd-47dd-4676-b37b-6a27ee0eaab4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:33.018776 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-776567fd-47dd-4676-b37b-6a27ee0eaab4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:33.020795 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-776567fd-47dd-4676-b37b-6a27ee0eaab4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.189219 Aug 05 07:20:33.021885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 304/615] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:32 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:33.165966 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-08e9c8a2-228b-471a-9d28-93e0c629d0c0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:33.166582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-08e9c8a2-228b-471a-9d28-93e0c629d0c0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:33.173751 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-08e9c8a2-228b-471a-9d28-93e0c629d0c0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:33.174265 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-08e9c8a2-228b-471a-9d28-93e0c629d0c0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:33.174679 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-08e9c8a2-228b-471a-9d28-93e0c629d0c0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:33.175401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-08e9c8a2-228b-471a-9d28-93e0c629d0c0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:33.175865 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-08e9c8a2-228b-471a-9d28-93e0c629d0c0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:33.176310 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-08e9c8a2-228b-471a-9d28-93e0c629d0c0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:33.190975 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-17242677-cec7-48eb-b062-53a36526737c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:33.191720 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-17242677-cec7-48eb-b062-53a36526737c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:33.199310 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-17242677-cec7-48eb-b062-53a36526737c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:33.199876 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-17242677-cec7-48eb-b062-53a36526737c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:33.200327 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-17242677-cec7-48eb-b062-53a36526737c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:33.201570 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-17242677-cec7-48eb-b062-53a36526737c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:33.202064 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-17242677-cec7-48eb-b062-53a36526737c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:33.202775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-17242677-cec7-48eb-b062-53a36526737c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:33.354046 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-08e9c8a2-228b-471a-9d28-93e0c629d0c0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:33.362796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-08e9c8a2-228b-471a-9d28-93e0c629d0c0 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1508 microversion: 2.1 time: 0.200676 Aug 05 07:20:33.363391 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 312/616] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:33 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:33.412731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-17242677-cec7-48eb-b062-53a36526737c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:33.421591 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-17242677-cec7-48eb-b062-53a36526737c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1575 microversion: 2.1 time: 0.234904 Aug 05 07:20:33.422287 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 305/617] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:33 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:33.703249 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d2da34d5-b39b-423e-ae26-e16cc2944339 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:33.703961 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d2da34d5-b39b-423e-ae26-e16cc2944339 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:33.711280 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2da34d5-b39b-423e-ae26-e16cc2944339 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:33.711770 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2da34d5-b39b-423e-ae26-e16cc2944339 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:33.712202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2da34d5-b39b-423e-ae26-e16cc2944339 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:33.712925 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2da34d5-b39b-423e-ae26-e16cc2944339 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:33.713437 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2da34d5-b39b-423e-ae26-e16cc2944339 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:33.713909 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2da34d5-b39b-423e-ae26-e16cc2944339 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:33.870967 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d2da34d5-b39b-423e-ae26-e16cc2944339 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:33.878794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d2da34d5-b39b-423e-ae26-e16cc2944339 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1674 microversion: 2.1 time: 0.179443 Aug 05 07:20:33.879379 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 313/618] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:33 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:34.050038 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2f5262a3-9b7c-43cb-bc95-aa8518eb0614 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:34.050784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2f5262a3-9b7c-43cb-bc95-aa8518eb0614 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:34.060717 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f5262a3-9b7c-43cb-bc95-aa8518eb0614 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:34.061225 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f5262a3-9b7c-43cb-bc95-aa8518eb0614 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:34.061650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f5262a3-9b7c-43cb-bc95-aa8518eb0614 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:34.062538 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f5262a3-9b7c-43cb-bc95-aa8518eb0614 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:34.063008 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f5262a3-9b7c-43cb-bc95-aa8518eb0614 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:34.063466 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f5262a3-9b7c-43cb-bc95-aa8518eb0614 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:34.208604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2f5262a3-9b7c-43cb-bc95-aa8518eb0614 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:34.220503 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2f5262a3-9b7c-43cb-bc95-aa8518eb0614 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:34.222779 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2f5262a3-9b7c-43cb-bc95-aa8518eb0614 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:34.224474 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2f5262a3-9b7c-43cb-bc95-aa8518eb0614 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.180517 Aug 05 07:20:34.225265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 306/619] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:34 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:34.386334 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-db739fdc-9553-4341-8af2-439ee544f0b7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:34.387026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-db739fdc-9553-4341-8af2-439ee544f0b7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:34.396462 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db739fdc-9553-4341-8af2-439ee544f0b7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:34.397270 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db739fdc-9553-4341-8af2-439ee544f0b7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:34.397842 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db739fdc-9553-4341-8af2-439ee544f0b7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:34.398959 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db739fdc-9553-4341-8af2-439ee544f0b7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:34.399639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db739fdc-9553-4341-8af2-439ee544f0b7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:34.400305 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db739fdc-9553-4341-8af2-439ee544f0b7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:34.443110 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-06a9d7f0-7722-4048-b12e-a7625485047e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:34.443726 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-06a9d7f0-7722-4048-b12e-a7625485047e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:34.450270 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06a9d7f0-7722-4048-b12e-a7625485047e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:34.450729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06a9d7f0-7722-4048-b12e-a7625485047e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:34.451269 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06a9d7f0-7722-4048-b12e-a7625485047e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:34.451971 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06a9d7f0-7722-4048-b12e-a7625485047e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:34.452419 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06a9d7f0-7722-4048-b12e-a7625485047e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:34.452837 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06a9d7f0-7722-4048-b12e-a7625485047e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:34.545864 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-db739fdc-9553-4341-8af2-439ee544f0b7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:34.554074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-db739fdc-9553-4341-8af2-439ee544f0b7 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1508 microversion: 2.1 time: 0.173355 Aug 05 07:20:34.554669 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 314/620] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:34 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:34.641472 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-06a9d7f0-7722-4048-b12e-a7625485047e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:34.650070 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-06a9d7f0-7722-4048-b12e-a7625485047e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1575 microversion: 2.1 time: 0.210759 Aug 05 07:20:34.650658 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 307/621] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:34 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:34.902139 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a320c819-8527-4ca2-869b-2c980f67bf53 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:34.902838 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a320c819-8527-4ca2-869b-2c980f67bf53 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:34.909557 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a320c819-8527-4ca2-869b-2c980f67bf53 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:34.910038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a320c819-8527-4ca2-869b-2c980f67bf53 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:34.910467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a320c819-8527-4ca2-869b-2c980f67bf53 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:34.911188 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a320c819-8527-4ca2-869b-2c980f67bf53 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:34.911628 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a320c819-8527-4ca2-869b-2c980f67bf53 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:34.912036 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a320c819-8527-4ca2-869b-2c980f67bf53 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:35.059397 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a320c819-8527-4ca2-869b-2c980f67bf53 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:35.067811 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a320c819-8527-4ca2-869b-2c980f67bf53 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1674 microversion: 2.1 time: 0.169811 Aug 05 07:20:35.068389 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 315/622] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:34 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:35.248883 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-65217627-2af6-4b36-803d-adddee7895d3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:35.249527 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-65217627-2af6-4b36-803d-adddee7895d3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:35.257359 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-65217627-2af6-4b36-803d-adddee7895d3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:35.257856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-65217627-2af6-4b36-803d-adddee7895d3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:35.258292 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-65217627-2af6-4b36-803d-adddee7895d3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:35.259009 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-65217627-2af6-4b36-803d-adddee7895d3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:35.259467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-65217627-2af6-4b36-803d-adddee7895d3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:35.259890 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-65217627-2af6-4b36-803d-adddee7895d3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:35.408755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-65217627-2af6-4b36-803d-adddee7895d3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:35.424309 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-65217627-2af6-4b36-803d-adddee7895d3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:35.427333 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-65217627-2af6-4b36-803d-adddee7895d3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:35.429631 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-65217627-2af6-4b36-803d-adddee7895d3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.184690 Aug 05 07:20:35.430732 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 308/623] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:35 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:35.575682 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0bd7dbcd-ae0d-4b7a-91ba-cf07b85ffbe2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:35.576219 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0bd7dbcd-ae0d-4b7a-91ba-cf07b85ffbe2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:35.583353 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bd7dbcd-ae0d-4b7a-91ba-cf07b85ffbe2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:35.583851 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bd7dbcd-ae0d-4b7a-91ba-cf07b85ffbe2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:35.584285 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bd7dbcd-ae0d-4b7a-91ba-cf07b85ffbe2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:35.585052 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bd7dbcd-ae0d-4b7a-91ba-cf07b85ffbe2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:35.585531 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bd7dbcd-ae0d-4b7a-91ba-cf07b85ffbe2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:35.585921 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0bd7dbcd-ae0d-4b7a-91ba-cf07b85ffbe2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:35.677724 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-35cbfccd-fc7f-4da2-a707-327796ea7f6d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:35.678378 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-35cbfccd-fc7f-4da2-a707-327796ea7f6d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:35.684851 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35cbfccd-fc7f-4da2-a707-327796ea7f6d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:35.685379 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35cbfccd-fc7f-4da2-a707-327796ea7f6d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:35.685815 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35cbfccd-fc7f-4da2-a707-327796ea7f6d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:35.686534 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35cbfccd-fc7f-4da2-a707-327796ea7f6d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:35.687121 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35cbfccd-fc7f-4da2-a707-327796ea7f6d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:35.687551 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35cbfccd-fc7f-4da2-a707-327796ea7f6d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:35.754434 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0bd7dbcd-ae0d-4b7a-91ba-cf07b85ffbe2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:35.764993 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0bd7dbcd-ae0d-4b7a-91ba-cf07b85ffbe2 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1508 microversion: 2.1 time: 0.193187 Aug 05 07:20:35.765882 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 316/624] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:35 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:35.863615 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-35cbfccd-fc7f-4da2-a707-327796ea7f6d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:35.873656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-35cbfccd-fc7f-4da2-a707-327796ea7f6d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1575 microversion: 2.1 time: 0.199213 Aug 05 07:20:35.873656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 309/625] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:35 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:36.096351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-747aaa4a-e61b-4e49-aa7f-2602acf4ba8b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:36.097161 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-747aaa4a-e61b-4e49-aa7f-2602acf4ba8b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:36.104561 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-747aaa4a-e61b-4e49-aa7f-2602acf4ba8b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:36.105087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-747aaa4a-e61b-4e49-aa7f-2602acf4ba8b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:36.105531 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-747aaa4a-e61b-4e49-aa7f-2602acf4ba8b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:36.106216 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-747aaa4a-e61b-4e49-aa7f-2602acf4ba8b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:36.106770 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-747aaa4a-e61b-4e49-aa7f-2602acf4ba8b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:36.107252 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-747aaa4a-e61b-4e49-aa7f-2602acf4ba8b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:36.335172 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-747aaa4a-e61b-4e49-aa7f-2602acf4ba8b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:36.348210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-747aaa4a-e61b-4e49-aa7f-2602acf4ba8b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1674 microversion: 2.1 time: 0.261067 Aug 05 07:20:36.349025 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 317/626] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:36 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1674 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:36.459367 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-36d9ce5d-260d-45e5-b6f5-cc0702cd7036 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:36.464274 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-36d9ce5d-260d-45e5-b6f5-cc0702cd7036 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:36.472720 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36d9ce5d-260d-45e5-b6f5-cc0702cd7036 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:36.473961 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36d9ce5d-260d-45e5-b6f5-cc0702cd7036 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:36.474812 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36d9ce5d-260d-45e5-b6f5-cc0702cd7036 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:36.476118 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36d9ce5d-260d-45e5-b6f5-cc0702cd7036 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:36.476825 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36d9ce5d-260d-45e5-b6f5-cc0702cd7036 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:36.477739 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36d9ce5d-260d-45e5-b6f5-cc0702cd7036 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:36.792948 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-dcfd456f-f8b1-4844-8f33-c5810445d507 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:36.794745 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-dcfd456f-f8b1-4844-8f33-c5810445d507 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:36.806743 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dcfd456f-f8b1-4844-8f33-c5810445d507 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:36.808002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dcfd456f-f8b1-4844-8f33-c5810445d507 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:36.809116 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dcfd456f-f8b1-4844-8f33-c5810445d507 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:36.810346 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dcfd456f-f8b1-4844-8f33-c5810445d507 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:36.811134 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dcfd456f-f8b1-4844-8f33-c5810445d507 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:36.812155 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dcfd456f-f8b1-4844-8f33-c5810445d507 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:37.032776 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-36d9ce5d-260d-45e5-b6f5-cc0702cd7036 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:37.044079 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-36d9ce5d-260d-45e5-b6f5-cc0702cd7036 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:37.046255 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-36d9ce5d-260d-45e5-b6f5-cc0702cd7036 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:37.048286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-36d9ce5d-260d-45e5-b6f5-cc0702cd7036 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1723 microversion: 2.20 time: 0.596159 Aug 05 07:20:37.048925 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 310/627] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:36 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1723 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:37.056594 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a451f11f-ee09-48f3-86ae-825f4bcee15a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:37.057939 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a451f11f-ee09-48f3-86ae-825f4bcee15a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:37.072434 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a451f11f-ee09-48f3-86ae-825f4bcee15a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:37.074344 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a451f11f-ee09-48f3-86ae-825f4bcee15a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:37.076155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a451f11f-ee09-48f3-86ae-825f4bcee15a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:37.077520 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a451f11f-ee09-48f3-86ae-825f4bcee15a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:37.079205 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a451f11f-ee09-48f3-86ae-825f4bcee15a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:37.080007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a451f11f-ee09-48f3-86ae-825f4bcee15a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:37.114836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-dcfd456f-f8b1-4844-8f33-c5810445d507 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:37.157960 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-dcfd456f-f8b1-4844-8f33-c5810445d507 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 200 len: 1508 microversion: 2.1 time: 0.372331 Aug 05 07:20:37.159758 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 318/628] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:36 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 1508 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:37.387013 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0c5be677-a44d-4dad-8873-43f6ca0074e5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:37.389368 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0c5be677-a44d-4dad-8873-43f6ca0074e5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:37.439650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c5be677-a44d-4dad-8873-43f6ca0074e5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:37.442399 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c5be677-a44d-4dad-8873-43f6ca0074e5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:37.444023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c5be677-a44d-4dad-8873-43f6ca0074e5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:37.446585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c5be677-a44d-4dad-8873-43f6ca0074e5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:37.447093 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c5be677-a44d-4dad-8873-43f6ca0074e5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:37.447530 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c5be677-a44d-4dad-8873-43f6ca0074e5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:37.836301 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0c5be677-a44d-4dad-8873-43f6ca0074e5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:37.879312 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0c5be677-a44d-4dad-8873-43f6ca0074e5 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1674 microversion: 2.1 time: 0.502128 Aug 05 07:20:37.887623 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 319/629] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:37 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1674 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:37.919018 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-8fd6bb03-83ac-4df8-9555-2e3eaa6cf957 req-2eb6de39-fb91-4c22-9324-dac51561d488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8759583-2a52-42ed-a5e0-c72a7000b211", "name": "network-vif-deleted", "tag": "1869529c-7cd6-42c5-9f0a-5d9ae0e48a24"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:37.962684 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-8fd6bb03-83ac-4df8-9555-2e3eaa6cf957 req-2eb6de39-fb91-4c22-9324-dac51561d488 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:37.963887 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-8fd6bb03-83ac-4df8-9555-2e3eaa6cf957 req-2eb6de39-fb91-4c22-9324-dac51561d488 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:37.965847 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-8fd6bb03-83ac-4df8-9555-2e3eaa6cf957 req-2eb6de39-fb91-4c22-9324-dac51561d488 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:37.988720 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-8fd6bb03-83ac-4df8-9555-2e3eaa6cf957 req-2eb6de39-fb91-4c22-9324-dac51561d488 service nova] Creating event network-vif-deleted:1869529c-7cd6-42c5-9f0a-5d9ae0e48a24 for instance c8759583-2a52-42ed-a5e0-c72a7000b211 on hv-cinder-85200 Aug 05 07:20:38.000308 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-8fd6bb03-83ac-4df8-9555-2e3eaa6cf957 req-2eb6de39-fb91-4c22-9324-dac51561d488 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109907 Aug 05 07:20:38.015193 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 320/630] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:38.045071 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a451f11f-ee09-48f3-86ae-825f4bcee15a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:38.048068 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-9dfda76b-3c2d-4538-a6b8-242d2bb60f76 req-6aaee01b-9bd9-4266-b9ab-da5917f6151d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f14ba1-bb82-4edf-baf2-308048c6c67c", "name": "network-vif-unplugged", "status": "completed", "tag": "7df94f6e-8c50-4ecc-aa16-ac32883658a4"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:38.070391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a451f11f-ee09-48f3-86ae-825f4bcee15a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1575 microversion: 2.1 time: 1.019825 Aug 05 07:20:38.070990 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 311/631] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:37 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1575 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:38.094880 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e0ad0f68-5949-446e-af8b-8fa9331cefdc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:38.096590 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e0ad0f68-5949-446e-af8b-8fa9331cefdc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:38.107663 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9dfda76b-3c2d-4538-a6b8-242d2bb60f76 req-6aaee01b-9bd9-4266-b9ab-da5917f6151d service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:38.111505 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9dfda76b-3c2d-4538-a6b8-242d2bb60f76 req-6aaee01b-9bd9-4266-b9ab-da5917f6151d service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:38.112930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9dfda76b-3c2d-4538-a6b8-242d2bb60f76 req-6aaee01b-9bd9-4266-b9ab-da5917f6151d service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:38.124486 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e0ad0f68-5949-446e-af8b-8fa9331cefdc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:38.126222 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e0ad0f68-5949-446e-af8b-8fa9331cefdc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:38.127408 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e0ad0f68-5949-446e-af8b-8fa9331cefdc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:38.129233 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e0ad0f68-5949-446e-af8b-8fa9331cefdc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:38.130958 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e0ad0f68-5949-446e-af8b-8fa9331cefdc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:38.132085 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e0ad0f68-5949-446e-af8b-8fa9331cefdc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:38.232628 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-9dfda76b-3c2d-4538-a6b8-242d2bb60f76 req-6aaee01b-9bd9-4266-b9ab-da5917f6151d service nova] Creating event network-vif-unplugged:7df94f6e-8c50-4ecc-aa16-ac32883658a4 for instance b8f14ba1-bb82-4edf-baf2-308048c6c67c on hv-cinder-85200 Aug 05 07:20:38.250081 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-9dfda76b-3c2d-4538-a6b8-242d2bb60f76 req-6aaee01b-9bd9-4266-b9ab-da5917f6151d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.225213 Aug 05 07:20:38.251157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 321/632] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:38.265751 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-df43e4cf-6a91-4f75-9a93-7d49efece620 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:38.267200 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-df43e4cf-6a91-4f75-9a93-7d49efece620 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: c8759583-2a52-42ed-a5e0-c72a7000b211] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:38.274330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-df43e4cf-6a91-4f75-9a93-7d49efece620 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:38.275174 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-df43e4cf-6a91-4f75-9a93-7d49efece620 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:38.275617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-df43e4cf-6a91-4f75-9a93-7d49efece620 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:38.282285 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-df43e4cf-6a91-4f75-9a93-7d49efece620 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:38.283149 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-df43e4cf-6a91-4f75-9a93-7d49efece620 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:38.283812 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-df43e4cf-6a91-4f75-9a93-7d49efece620 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:38.300646 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e0ad0f68-5949-446e-af8b-8fa9331cefdc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:38.302033 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-df43e4cf-6a91-4f75-9a93-7d49efece620 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] HTTP exception thrown: Instance c8759583-2a52-42ed-a5e0-c72a7000b211 could not be found. Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-df43e4cf-6a91-4f75-9a93-7d49efece620 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Request method failure captured: Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 HTTP/1.1 Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MM-EQUpnzTV_TuaBii4EnDtucJf3DBJQuckc_cz-EahkMlyKuaPdeRlNPw5xVtsl6C2UBh_Yoa08ue84u1Lxb6YzWInBS__DjPsZZfDUKm9pQ3Ro_hNX8NmosRUVx0DbFBQGMhI8X49NbxrPMBizm2j_rmdwFPmQfNSyM6KMFZP8bo Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: fe39edf907ff48518759474a800b949d Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:20:38.304027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:20:38.305360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe39edf907ff48518759474a800b949d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe39edf907ff48518759474a800b949d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe39edf907ff48518759474a800b949d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe39edf907ff48518759474a800b949d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:20:38.305360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:20:38.305360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: fe39edf907ff48518759474a800b949d Aug 05 07:20:38.305360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:20:38.305360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-ServerRescueNegativeTestJSON-619170576-project Aug 05 07:20:38.305360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:20:38.305360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:20:38.305360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 2ce8bf4f0ab64010b3855193f55971d2 Aug 05 07:20:38.305360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-ServerRescueNegativeTestJSON-619170576-project Aug 05 07:20:38.305360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:20:38.305360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance c8759583-2a52-42ed-a5e0-c72a7000b211 could not be found. Aug 05 07:20:38.305360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'c8759583-2a52-42ed-a5e0-c72a7000b211'} Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8759583-2a52-42ed-a5e0-c72a7000b211 could not be found. Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:20:38.306087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8759583-2a52-42ed-a5e0-c72a7000b211 could not be found. Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8759583-2a52-42ed-a5e0-c72a7000b211 could not be found. Aug 05 07:20:38.307250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:38.310604 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-df43e4cf-6a91-4f75-9a93-7d49efece620 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Returning 404 to user: Instance c8759583-2a52-42ed-a5e0-c72a7000b211 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:20:38.311868 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-df43e4cf-6a91-4f75-9a93-7d49efece620 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211" status: 404 len: 111 microversion: 2.1 time: 0.056526 Aug 05 07:20:38.312849 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 322/633] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:38 2022] GET /compute/v2.1/servers/c8759583-2a52-42ed-a5e0-c72a7000b211 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:20:38.322284 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e0ad0f68-5949-446e-af8b-8fa9331cefdc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:38.325280 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2aece77f-0ded-4432-9b2e-3a42b92e0f0c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:38.325954 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e0ad0f68-5949-446e-af8b-8fa9331cefdc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:38.327518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2aece77f-0ded-4432-9b2e-3a42b92e0f0c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:38.328287 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e0ad0f68-5949-446e-af8b-8fa9331cefdc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1365 microversion: 2.20 time: 0.240999 Aug 05 07:20:38.330180 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 312/634] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:38 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:38.339858 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2aece77f-0ded-4432-9b2e-3a42b92e0f0c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:38.340821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2aece77f-0ded-4432-9b2e-3a42b92e0f0c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:38.341662 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2aece77f-0ded-4432-9b2e-3a42b92e0f0c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:38.342633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2aece77f-0ded-4432-9b2e-3a42b92e0f0c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:38.343426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2aece77f-0ded-4432-9b2e-3a42b92e0f0c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:38.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2aece77f-0ded-4432-9b2e-3a42b92e0f0c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:38.385764 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2aece77f-0ded-4432-9b2e-3a42b92e0f0c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Going to try to terminate instance {{(pid=117894) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:20:38.535152 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2aece77f-0ded-4432-9b2e-3a42b92e0f0c tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 204 len: 0 microversion: 2.1 time: 0.216337 Aug 05 07:20:38.536343 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 323/635] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:20:38 2022] DELETE /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 07:20:38.546772 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d5605047-db8d-462b-9b6b-dde9b1b117b1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:38.547776 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d5605047-db8d-462b-9b6b-dde9b1b117b1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:38.556538 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d5605047-db8d-462b-9b6b-dde9b1b117b1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:38.557351 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d5605047-db8d-462b-9b6b-dde9b1b117b1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:38.557964 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d5605047-db8d-462b-9b6b-dde9b1b117b1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:38.558852 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d5605047-db8d-462b-9b6b-dde9b1b117b1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:38.559546 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d5605047-db8d-462b-9b6b-dde9b1b117b1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:38.560133 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d5605047-db8d-462b-9b6b-dde9b1b117b1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:38.933796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-693c5995-94af-46d8-91bf-bf001c86ea21 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:38.934639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-693c5995-94af-46d8-91bf-bf001c86ea21 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:38.945713 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-693c5995-94af-46d8-91bf-bf001c86ea21 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:38.946746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-693c5995-94af-46d8-91bf-bf001c86ea21 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:38.947724 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-693c5995-94af-46d8-91bf-bf001c86ea21 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:38.948698 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-693c5995-94af-46d8-91bf-bf001c86ea21 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:38.949483 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-693c5995-94af-46d8-91bf-bf001c86ea21 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:38.950190 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-693c5995-94af-46d8-91bf-bf001c86ea21 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:38.950849 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d5605047-db8d-462b-9b6b-dde9b1b117b1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:38.964984 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d5605047-db8d-462b-9b6b-dde9b1b117b1 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.422716 Aug 05 07:20:38.978099 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 313/636] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:38 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:39.047131 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-693c5995-94af-46d8-91bf-bf001c86ea21 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:39.059115 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-693c5995-94af-46d8-91bf-bf001c86ea21 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1606 microversion: 2.1 time: 0.130805 Aug 05 07:20:39.061080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 324/637] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:38 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1606 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:39.113405 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b392ccc2-312e-4f5b-9b9f-bcdf4ed44ae8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:39.115036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b392ccc2-312e-4f5b-9b9f-bcdf4ed44ae8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:39.130337 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b392ccc2-312e-4f5b-9b9f-bcdf4ed44ae8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:39.130840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b392ccc2-312e-4f5b-9b9f-bcdf4ed44ae8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:39.131284 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b392ccc2-312e-4f5b-9b9f-bcdf4ed44ae8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:39.132014 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b392ccc2-312e-4f5b-9b9f-bcdf4ed44ae8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:39.132469 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b392ccc2-312e-4f5b-9b9f-bcdf4ed44ae8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:39.132921 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b392ccc2-312e-4f5b-9b9f-bcdf4ed44ae8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:39.242182 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b392ccc2-312e-4f5b-9b9f-bcdf4ed44ae8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:39.258958 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b392ccc2-312e-4f5b-9b9f-bcdf4ed44ae8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1509 microversion: 2.1 time: 0.149548 Aug 05 07:20:39.260244 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 314/638] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:39 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:20:39.369659 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:39.370098 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:39.386680 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:39.387628 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:39.388226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:39.389231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:39.390865 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:39.392718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:39.480888 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-4c1f04ed-0c10-4446-b0be-3339d5443e94 req-9dff50b9-6641-49a0-a93f-4ee0897bd270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf59ded-e598-4ac7-ba2e-9a3c2210d007", "name": "network-vif-deleted", "tag": "ede42d65-04d0-40ad-8a04-8c635128bf7f"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:39.496162 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:39.496761 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:39.497297 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:39.497867 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lazy-loading 'fault' on Instance uuid f664511a-28db-4ff6-90e9-7e2db58e94e2 {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:20:39.508852 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4c1f04ed-0c10-4446-b0be-3339d5443e94 req-9dff50b9-6641-49a0-a93f-4ee0897bd270 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:39.509885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4c1f04ed-0c10-4446-b0be-3339d5443e94 req-9dff50b9-6641-49a0-a93f-4ee0897bd270 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:39.511033 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4c1f04ed-0c10-4446-b0be-3339d5443e94 req-9dff50b9-6641-49a0-a93f-4ee0897bd270 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:39.531207 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-4c1f04ed-0c10-4446-b0be-3339d5443e94 req-9dff50b9-6641-49a0-a93f-4ee0897bd270 service nova] Creating event network-vif-deleted:ede42d65-04d0-40ad-8a04-8c635128bf7f for instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 on hv-cinder-85200 Aug 05 07:20:39.538562 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-4c1f04ed-0c10-4446-b0be-3339d5443e94 req-9dff50b9-6641-49a0-a93f-4ee0897bd270 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161090 Aug 05 07:20:39.539271 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 315/639] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:39.607280 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:39.611188 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:39.617576 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:39.619296 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:39.620831 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-dbeb45f3-5dcf-4fd4-8641-d12f69ca2c30 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1370 microversion: 2.20 time: 0.255811 Aug 05 07:20:39.622038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 325/640] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:39 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1370 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:39.989918 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-08508e29-8895-43e9-999e-73dddbde475b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:39.991024 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-08508e29-8895-43e9-999e-73dddbde475b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:39.998493 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-08508e29-8895-43e9-999e-73dddbde475b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:39.999411 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-08508e29-8895-43e9-999e-73dddbde475b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:39.999996 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-08508e29-8895-43e9-999e-73dddbde475b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:40.001010 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-08508e29-8895-43e9-999e-73dddbde475b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:40.002159 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-08508e29-8895-43e9-999e-73dddbde475b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:40.003585 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-08508e29-8895-43e9-999e-73dddbde475b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:40.050281 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-ed3131ca-9b8d-48fe-ad69-ff0ac981c603 req-ff3cc9df-fe37-4046-87dc-f8e5b1830f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f664511a-28db-4ff6-90e9-7e2db58e94e2", "name": "network-vif-deleted", "tag": "986a1785-c18c-444a-af3e-101b2ea68ae7"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:40.077598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-ed3131ca-9b8d-48fe-ad69-ff0ac981c603 req-ff3cc9df-fe37-4046-87dc-f8e5b1830f18 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:40.078746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-ed3131ca-9b8d-48fe-ad69-ff0ac981c603 req-ff3cc9df-fe37-4046-87dc-f8e5b1830f18 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:40.079926 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-ed3131ca-9b8d-48fe-ad69-ff0ac981c603 req-ff3cc9df-fe37-4046-87dc-f8e5b1830f18 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:40.108410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-ed3131ca-9b8d-48fe-ad69-ff0ac981c603 req-ff3cc9df-fe37-4046-87dc-f8e5b1830f18 service nova] Creating event network-vif-deleted:986a1785-c18c-444a-af3e-101b2ea68ae7 for instance f664511a-28db-4ff6-90e9-7e2db58e94e2 on hv-cinder-85200 Aug 05 07:20:40.120476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-ed3131ca-9b8d-48fe-ad69-ff0ac981c603 req-ff3cc9df-fe37-4046-87dc-f8e5b1830f18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086002 Aug 05 07:20:40.129398 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 326/641] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:40.143508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7fb09b46-62f6-46fb-a151-fc4c9837aee7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:40.145177 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7fb09b46-62f6-46fb-a151-fc4c9837aee7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:40.159964 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fb09b46-62f6-46fb-a151-fc4c9837aee7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:40.160807 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fb09b46-62f6-46fb-a151-fc4c9837aee7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:40.161850 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fb09b46-62f6-46fb-a151-fc4c9837aee7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:40.163639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fb09b46-62f6-46fb-a151-fc4c9837aee7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:40.164485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fb09b46-62f6-46fb-a151-fc4c9837aee7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:40.165285 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fb09b46-62f6-46fb-a151-fc4c9837aee7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:40.179222 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-08508e29-8895-43e9-999e-73dddbde475b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:40.190265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-08508e29-8895-43e9-999e-73dddbde475b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.204608 Aug 05 07:20:40.205945 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 316/642] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:39 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:40.264594 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7fb09b46-62f6-46fb-a151-fc4c9837aee7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:40.273324 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7fb09b46-62f6-46fb-a151-fc4c9837aee7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1606 microversion: 2.1 time: 0.141469 Aug 05 07:20:40.286404 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 327/643] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:40 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1606 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:40.287591 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7fb21fd8-c4b3-4287-9a34-25bfafda4ad5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:40.287591 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7fb21fd8-c4b3-4287-9a34-25bfafda4ad5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:40.292810 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7fb21fd8-c4b3-4287-9a34-25bfafda4ad5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:40.293342 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7fb21fd8-c4b3-4287-9a34-25bfafda4ad5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:40.293776 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7fb21fd8-c4b3-4287-9a34-25bfafda4ad5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:40.294529 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7fb21fd8-c4b3-4287-9a34-25bfafda4ad5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:40.295146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7fb21fd8-c4b3-4287-9a34-25bfafda4ad5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:40.295591 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7fb21fd8-c4b3-4287-9a34-25bfafda4ad5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:40.370293 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7fb21fd8-c4b3-4287-9a34-25bfafda4ad5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:40.379208 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7fb21fd8-c4b3-4287-9a34-25bfafda4ad5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1509 microversion: 2.1 time: 0.100960 Aug 05 07:20:40.379801 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 317/644] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:40 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1509 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:40.650213 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:40.652094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:40.665764 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:40.669780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:40.670926 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:40.672457 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:40.678200 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:40.679221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:40.767927 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:40.768489 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:40.768954 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:40.769413 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lazy-loading 'fault' on Instance uuid f664511a-28db-4ff6-90e9-7e2db58e94e2 {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:20:40.832670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:40.842790 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:40.844665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:40.845937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-80728a2b-d6fa-4fd5-b762-6948dbfd15ea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 200 len: 1370 microversion: 2.20 time: 0.203501 Aug 05 07:20:40.862293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 328/645] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:40 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:41.214712 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-05899a6c-f6a0-40af-9535-bf91167d6f10 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:41.215818 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-05899a6c-f6a0-40af-9535-bf91167d6f10 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:41.226649 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-05899a6c-f6a0-40af-9535-bf91167d6f10 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:41.227200 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-05899a6c-f6a0-40af-9535-bf91167d6f10 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:41.227778 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-05899a6c-f6a0-40af-9535-bf91167d6f10 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:41.228878 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-05899a6c-f6a0-40af-9535-bf91167d6f10 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:41.229879 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-05899a6c-f6a0-40af-9535-bf91167d6f10 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:41.230386 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-05899a6c-f6a0-40af-9535-bf91167d6f10 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:41.295306 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:41.295912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:41.302788 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:41.303267 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:41.303717 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:41.304426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:41.304869 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:41.305322 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:41.352113 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:41.352961 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:41.353771 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:41.354612 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lazy-loading 'fault' on Instance uuid acf59ded-e598-4ac7-ba2e-9a3c2210d007 {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:20:41.384610 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-05899a6c-f6a0-40af-9535-bf91167d6f10 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:41.399056 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-05899a6c-f6a0-40af-9535-bf91167d6f10 tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1523 microversion: 2.1 time: 0.189847 Aug 05 07:20:41.400832 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 318/646] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:41 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:41.410470 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:41.411816 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:41.413837 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:41.426919 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:41.428167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:41.429127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:41.430244 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d2cde19d-6c6f-4ff4-baf8-565d2bab31d3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 200 len: 1328 microversion: 2.1 time: 0.138169 Aug 05 07:20:41.430943 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:41.431671 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 329/647] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:41 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 1328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:20:41.432166 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:41.433199 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:41.495611 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:41.496199 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:41.496731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:41.497285 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lazy-loading 'fault' on Instance uuid b8f14ba1-bb82-4edf-baf2-308048c6c67c {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:20:41.565914 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:41.567049 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-0a9a0ec7-a9d7-4032-9d65-5d3bd3e88a96 req-a94ffb71-1db7-4826-b3f6-dbc818a9553b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f14ba1-bb82-4edf-baf2-308048c6c67c", "name": "network-vif-deleted", "tag": "7df94f6e-8c50-4ecc-aa16-ac32883658a4"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:41.580883 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-239e8459-59b1-4a9a-b886-0ffb3cf84a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 200 len: 1230 microversion: 2.1 time: 0.177845 Aug 05 07:20:41.582391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 319/648] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:41 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 1230 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:41.584448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-0a9a0ec7-a9d7-4032-9d65-5d3bd3e88a96 req-a94ffb71-1db7-4826-b3f6-dbc818a9553b service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:41.585328 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-0a9a0ec7-a9d7-4032-9d65-5d3bd3e88a96 req-a94ffb71-1db7-4826-b3f6-dbc818a9553b service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:41.586128 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-0a9a0ec7-a9d7-4032-9d65-5d3bd3e88a96 req-a94ffb71-1db7-4826-b3f6-dbc818a9553b service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:41.609013 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-0a9a0ec7-a9d7-4032-9d65-5d3bd3e88a96 req-a94ffb71-1db7-4826-b3f6-dbc818a9553b service nova] Creating event network-vif-deleted:7df94f6e-8c50-4ecc-aa16-ac32883658a4 for instance b8f14ba1-bb82-4edf-baf2-308048c6c67c on hv-cinder-85200 Aug 05 07:20:41.614874 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-0a9a0ec7-a9d7-4032-9d65-5d3bd3e88a96 req-a94ffb71-1db7-4826-b3f6-dbc818a9553b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054417 Aug 05 07:20:41.615633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 330/649] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:20:41.885345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7daaf8ca-aee6-4695-a21c-bd2c3933529a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:41.886879 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7daaf8ca-aee6-4695-a21c-bd2c3933529a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:41.895910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7daaf8ca-aee6-4695-a21c-bd2c3933529a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:41.896965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7daaf8ca-aee6-4695-a21c-bd2c3933529a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:41.897578 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7daaf8ca-aee6-4695-a21c-bd2c3933529a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:41.898583 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7daaf8ca-aee6-4695-a21c-bd2c3933529a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:41.900841 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7daaf8ca-aee6-4695-a21c-bd2c3933529a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:41.902324 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7daaf8ca-aee6-4695-a21c-bd2c3933529a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:41.911128 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:41.936036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-7daaf8ca-aee6-4695-a21c-bd2c3933529a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] HTTP exception thrown: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7daaf8ca-aee6-4695-a21c-bd2c3933529a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Request method failure captured: Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 HTTP/1.1 Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MOkhlZtna41j2Y-lGyoDQsuQs1nBOgOAGA7HNPtonJ6KaI55B26wAQrSxM8bxgj35LDuzk_w6WMhL9fd4rTzLZvoHPrU5GIl8o8xHqP0q7vav6maAEbq5GwF1olu80B06DeDXAMU1IOZxFnKHcluEfRpXv6h2NrAYPZLwQbCv5pPQw Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: f3385eb4afc441ba834ec0ddc1c3fd9a Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:20:41.939500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:20:41.941313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f3385eb4afc441ba834ec0ddc1c3fd9a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:20:41.941313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:20:41.941313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: f3385eb4afc441ba834ec0ddc1c3fd9a Aug 05 07:20:41.941313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:20:41.941313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeShelveTestJSON-505625477-project Aug 05 07:20:41.941313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:20:41.941313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:20:41.941313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 723cdd3baceb4f51a57df4863af99c3e Aug 05 07:20:41.941313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeShelveTestJSON-505625477-project Aug 05 07:20:41.941313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:20:41.941313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:20:41.941313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'f664511a-28db-4ff6-90e9-7e2db58e94e2'} Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:20:41.942266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:20:41.943675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:41.945000 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7daaf8ca-aee6-4695-a21c-bd2c3933529a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Returning 404 to user: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:20:41.945000 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7daaf8ca-aee6-4695-a21c-bd2c3933529a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 404 len: 111 microversion: 2.20 time: 0.074974 Aug 05 07:20:41.947496 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 320/650] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:41 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 07:20:41.954984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-dd127e2a-73e8-4f43-92a3-8fda6fe5a966 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '.version_select at 0x7f4963e67a60>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:41.964579 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:41.979791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-dd127e2a-73e8-4f43-92a3-8fda6fe5a966 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-75278466" status: 204 len: 0 microversion: 2.20 time: 0.029453 Aug 05 07:20:41.980386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 331/651] 10.222.0.27 () {60 vars in 1256 bytes} [Fri Aug 5 07:20:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-75278466 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 05 07:20:42.426425 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:42.430498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:42.451427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:42.452618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:42.453756 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:42.455104 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:42.455923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:42.456691 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:42.470759 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-22519efe-e3db-4cd2-b9b8-e4965419698e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:42.473401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-22519efe-e3db-4cd2-b9b8-e4965419698e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:42.492157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-22519efe-e3db-4cd2-b9b8-e4965419698e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:42.493439 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-22519efe-e3db-4cd2-b9b8-e4965419698e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:42.495447 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-22519efe-e3db-4cd2-b9b8-e4965419698e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:42.496508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-22519efe-e3db-4cd2-b9b8-e4965419698e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:42.497401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-22519efe-e3db-4cd2-b9b8-e4965419698e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:42.498188 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-22519efe-e3db-4cd2-b9b8-e4965419698e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:42.510297 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:42.510784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:42.511226 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:42.511697 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lazy-loading 'fault' on Instance uuid f899e07a-87f6-4228-9dc1-c92ec3eed017 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:20:42.535332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-22519efe-e3db-4cd2-b9b8-e4965419698e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] HTTP exception thrown: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-22519efe-e3db-4cd2-b9b8-e4965419698e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Request method failure captured: Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 HTTP/1.1 Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MNBTDCZ7vuHhKvRHlEolB_BW0oVjjNghGAxUIK_WfiG5SlIYB7JtF8WGOCWa0MS7l3cF996IDPMNyVGNRkTktVGp6mkHasP_zMBXg3OVYJp3jZybhGIjMqjC03Lw5CtORoMEpty1Jc2cK0RTv6UTCvion696PpRu7Z-Xpy2-a4KNjM Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 92e23c5c336e486f995f88c12b72b2c5 Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:20:42.540038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:20:42.542367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_92e23c5c336e486f995f88c12b72b2c5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:20:42.542367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:20:42.542367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 92e23c5c336e486f995f88c12b72b2c5 Aug 05 07:20:42.542367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:20:42.542367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeTestJSON-201491328-project Aug 05 07:20:42.542367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:20:42.542367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:20:42.542367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 02c685b300874351ab2dbd62bea1a669 Aug 05 07:20:42.542367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeTestJSON-201491328-project Aug 05 07:20:42.542367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:20:42.542367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:20:42.542367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'acf59ded-e598-4ac7-ba2e-9a3c2210d007'} Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:20:42.543564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:20:42.548947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:20:42.555667 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-22519efe-e3db-4cd2-b9b8-e4965419698e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Returning 404 to user: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:20:42.557701 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-22519efe-e3db-4cd2-b9b8-e4965419698e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 404 len: 111 microversion: 2.1 time: 0.093751 Aug 05 07:20:42.566897 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce8bf4f0ab64010b3855193f55971d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe39edf907ff48518759474a800b949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:42.568797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 332/652] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:42 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:20:42.582064 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4da04ede-6c27-4f60-abae-2ea6030623a8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '.version_select at 0x7f4963e07b80>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:42.590932 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b09f5113-399a-4be4-b498-74a5214ff12b tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 200 len: 1312 microversion: 2.1 time: 0.173148 Aug 05 07:20:42.593645 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 321/653] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:42 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:20:42.610825 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8f93a40b-5f71-437c-8cbb-0c059f6bd38b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:42.612425 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8f93a40b-5f71-437c-8cbb-0c059f6bd38b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:42.625132 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8f93a40b-5f71-437c-8cbb-0c059f6bd38b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:42.626710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8f93a40b-5f71-437c-8cbb-0c059f6bd38b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:42.627870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8f93a40b-5f71-437c-8cbb-0c059f6bd38b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:42.630207 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8f93a40b-5f71-437c-8cbb-0c059f6bd38b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:42.631061 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8f93a40b-5f71-437c-8cbb-0c059f6bd38b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:42.631851 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8f93a40b-5f71-437c-8cbb-0c059f6bd38b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:42.633369 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4da04ede-6c27-4f60-abae-2ea6030623a8 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145748143" status: 202 len: 0 microversion: 2.1 time: 0.062537 Aug 05 07:20:42.634395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 333/654] 10.222.0.27 () {58 vars in 1221 bytes} [Fri Aug 5 07:20:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145748143 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:20:42.668597 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-8f93a40b-5f71-437c-8cbb-0c059f6bd38b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] HTTP exception thrown: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8f93a40b-5f71-437c-8cbb-0c059f6bd38b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Request method failure captured: Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c HTTP/1.1 Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MPjnss623grFw3OIsxvZyPD5d8DyUIJ9IvlHez0UG_G_JbTgoBftEKBd_N4FPQc5BXdwd3FB4TNCJbLP1EHNenLcBf1QKCl2wyv6M5a2nhx962v4gzpTEHdQ2X6Ig_NG89llIU4w4nIQO3MgNwg4AXUZuq3Wx8Qk0y83rDyfIdZhLg Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 2720b0660de14a19a05ef57efaa01cd8 Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:20:42.673081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:20:42.674536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2720b0660de14a19a05ef57efaa01cd8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:20:42.674536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:20:42.674536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 2720b0660de14a19a05ef57efaa01cd8 Aug 05 07:20:42.674536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:20:42.674536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-TestVolumeBootPattern-1137302503-project Aug 05 07:20:42.674536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:20:42.674536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:20:42.674536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 43ef613541cb4fd49faa3a3cec1a58c8 Aug 05 07:20:42.674536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-TestVolumeBootPattern-1137302503-project Aug 05 07:20:42.674536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:20:42.674536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:20:42.674536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'b8f14ba1-bb82-4edf-baf2-308048c6c67c'} Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:20:42.675345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:20:42.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:42.677800 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8f93a40b-5f71-437c-8cbb-0c059f6bd38b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Returning 404 to user: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:20:42.677800 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8f93a40b-5f71-437c-8cbb-0c059f6bd38b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 404 len: 111 microversion: 2.1 time: 0.074061 Aug 05 07:20:42.678727 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 322/655] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:42 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:20:42.762964 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1905206190", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1981702890", "security_groups": [{"name": "tempest-secgroup-smoke-58290517"}], "block_device_mapping_v2": [{"uuid": "4ac81565-9d68-460e-93e9-81139bc1778f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "898bc1bf-853e-4d5f-beef-8e86d982e4a4"}]}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:43.029166 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] validate_networks() for [('898bc1bf-853e-4d5f-beef-8e86d982e4a4', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:20:43.139558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-939dcfb4-0e14-42ce-90eb-d937a1094c3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Action: 'create', calling method: .version_select at 0x7f49706209d0>, body: {"keypair": {"name": "tempest-keypair-1721325610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA7VK7X7zgiYtvIcHG2TfJdHb8iKQuAx+RMxAlzMOyOscUQNEVoDDxlVQr6N4Cuf3B8ZFJWhChPvL/+se9fs1AowGJ4Z1Q9M89ISN/uFpL0fLKItk0sm2PJQO++O1JGtg=="}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:43.161405 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-939dcfb4-0e14-42ce-90eb-d937a1094c3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Getting quotas for project f3385eb4afc441ba834ec0ddc1c3fd9a. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:20:43.168092 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-939dcfb4-0e14-42ce-90eb-d937a1094c3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Getting quotas for user 723cdd3baceb4f51a57df4863af99c3e and project f3385eb4afc441ba834ec0ddc1c3fd9a. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:20:43.202150 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-939dcfb4-0e14-42ce-90eb-d937a1094c3e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.068015 Aug 05 07:20:43.203247 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 323/656] 10.222.0.27 () {62 vars in 1200 bytes} [Fri Aug 5 07:20:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 05 07:20:43.621837 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e86e47cc-005f-498d-a2c5-e48655420f34 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Action: 'create', calling method: .version_select at 0x7f49705cfee0>, body: {"keypair": {"name": "tempest-keypair-1542233691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZM4vkGZHKQUmGBTefhNO0A0aMd97gLIcRL96Hxs6Yj8tB8EnUXF34ZbcVaVhjeBKMOhbK4wwKEGGn/w5UW6kiCzTw2T/qy1rl3SJHTwrqJ4nRd+UpN16hNkF9BgKabAQ=="}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:43.632410 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:43.645920 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-e86e47cc-005f-498d-a2c5-e48655420f34 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Getting quotas for project 92e23c5c336e486f995f88c12b72b2c5. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:20:43.651948 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-e86e47cc-005f-498d-a2c5-e48655420f34 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Getting quotas for user 02c685b300874351ab2dbd62bea1a669 and project 92e23c5c336e486f995f88c12b72b2c5. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:20:43.682757 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e86e47cc-005f-498d-a2c5-e48655420f34 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065872 Aug 05 07:20:43.683381 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 324/657] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 5 07:20:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:20:43.688239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-87a4c0c6-7773-43e9-a23f-37742cfaaeea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:43.688845 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-87a4c0c6-7773-43e9-a23f-37742cfaaeea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] [instance: f899e07a-87f6-4228-9dc1-c92ec3eed017] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:43.696256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87a4c0c6-7773-43e9-a23f-37742cfaaeea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:43.697003 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87a4c0c6-7773-43e9-a23f-37742cfaaeea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:43.697442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87a4c0c6-7773-43e9-a23f-37742cfaaeea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:43.698154 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87a4c0c6-7773-43e9-a23f-37742cfaaeea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:43.698605 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87a4c0c6-7773-43e9-a23f-37742cfaaeea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:43.699023 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87a4c0c6-7773-43e9-a23f-37742cfaaeea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:43.709416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:20:43.710596 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:20:43.711837 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:20:43.713657 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:20:43.714962 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:20:43.715151 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-87a4c0c6-7773-43e9-a23f-37742cfaaeea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] HTTP exception thrown: Instance f899e07a-87f6-4228-9dc1-c92ec3eed017 could not be found. Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-87a4c0c6-7773-43e9-a23f-37742cfaaeea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Request method failure captured: Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 HTTP/1.1 Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MM-EQUpnzTV_TuaBii4EnDtucJf3DBJQuckc_cz-EahkMlyKuaPdeRlNPw5xVtsl6C2UBh_Yoa08ue84u1Lxb6YzWInBS__DjPsZZfDUKm9pQ3Ro_hNX8NmosRUVx0DbFBQGMhI8X49NbxrPMBizm2j_rmdwFPmQfNSyM6KMFZP8bo Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: fe39edf907ff48518759474a800b949d Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:20:43.716729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:20:43.719625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe39edf907ff48518759474a800b949d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe39edf907ff48518759474a800b949d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe39edf907ff48518759474a800b949d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe39edf907ff48518759474a800b949d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:20:43.719625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:20:43.719625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: fe39edf907ff48518759474a800b949d Aug 05 07:20:43.719625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-619170576 Aug 05 07:20:43.719625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-ServerRescueNegativeTestJSON-619170576-project Aug 05 07:20:43.719625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:20:43.719625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:20:43.719625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 2ce8bf4f0ab64010b3855193f55971d2 Aug 05 07:20:43.719625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-ServerRescueNegativeTestJSON-619170576-project Aug 05 07:20:43.719625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:20:43.719625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance f899e07a-87f6-4228-9dc1-c92ec3eed017 could not be found. Aug 05 07:20:43.719625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'f899e07a-87f6-4228-9dc1-c92ec3eed017'} Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f899e07a-87f6-4228-9dc1-c92ec3eed017 could not be found. Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:20:43.721291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f899e07a-87f6-4228-9dc1-c92ec3eed017 could not be found. Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f899e07a-87f6-4228-9dc1-c92ec3eed017 could not be found. Aug 05 07:20:43.724236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:20:43.728187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-87a4c0c6-7773-43e9-a23f-37742cfaaeea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] Returning 404 to user: Instance f899e07a-87f6-4228-9dc1-c92ec3eed017 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:20:43.728187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-87a4c0c6-7773-43e9-a23f-37742cfaaeea tempest-ServerRescueNegativeTestJSON-619170576 tempest-ServerRescueNegativeTestJSON-619170576-project] 10.222.0.27 "GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017" status: 404 len: 111 microversion: 2.1 time: 0.033856 Aug 05 07:20:43.728187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 325/658] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:43 2022] GET /compute/v2.1/servers/f899e07a-87f6-4228-9dc1-c92ec3eed017 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:20:43.728187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-e0e05de5-5367-4118-b9bf-40d1bfde3292 req-d2ef277d-74a2-4140-81ba-5e403817cf32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f899e07a-87f6-4228-9dc1-c92ec3eed017", "name": "network-vif-deleted", "tag": "ca9499bf-08de-46eb-b235-f09c2fccac1d"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:43.736794 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e0e05de5-5367-4118-b9bf-40d1bfde3292 req-d2ef277d-74a2-4140-81ba-5e403817cf32 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:43.737489 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e0e05de5-5367-4118-b9bf-40d1bfde3292 req-d2ef277d-74a2-4140-81ba-5e403817cf32 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:43.738095 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e0e05de5-5367-4118-b9bf-40d1bfde3292 req-d2ef277d-74a2-4140-81ba-5e403817cf32 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:43.752167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:43.753342 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:43.754112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:43.755472 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:43.755611 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-e0e05de5-5367-4118-b9bf-40d1bfde3292 req-d2ef277d-74a2-4140-81ba-5e403817cf32 service nova] Creating event network-vif-deleted:ca9499bf-08de-46eb-b235-f09c2fccac1d for instance f899e07a-87f6-4228-9dc1-c92ec3eed017 on hv-cinder-85200 Aug 05 07:20:43.756298 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:43.757365 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:43.761021 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-e0e05de5-5367-4118-b9bf-40d1bfde3292 req-d2ef277d-74a2-4140-81ba-5e403817cf32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040404 Aug 05 07:20:43.761973 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 326/659] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:43.783589 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Getting quotas for project 2720b0660de14a19a05ef57efaa01cd8. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:20:43.811095 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Getting quotas for user 43ef613541cb4fd49faa3a3cec1a58c8 and project 2720b0660de14a19a05ef57efaa01cd8. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:20:43.951269 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:20:43.956081 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4ac81565-9d68-460e-93e9-81139bc1778f',volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:20:44.195218 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f0be46f3-97fc-4cd2-93e9-4c6e253a9679 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.440219 Aug 05 07:20:44.204983 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 334/660] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:20:42 2022] POST /compute/v2.1/servers => generated 404 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 07:20:44.211211 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cce5ed9c-7d8e-4d8f-ab59-f1582c4644fb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:44.212139 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cce5ed9c-7d8e-4d8f-ab59-f1582c4644fb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:44.652822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cce5ed9c-7d8e-4d8f-ab59-f1582c4644fb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:44.665856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cce5ed9c-7d8e-4d8f-ab59-f1582c4644fb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1095 microversion: 2.1 time: 0.459326 Aug 05 07:20:44.666769 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 327/661] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:44 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1095 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:20:45.701798 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ff37733b-39de-4d8b-b79e-5f6d13aa2476 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:45.702398 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ff37733b-39de-4d8b-b79e-5f6d13aa2476 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:45.718134 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ff37733b-39de-4d8b-b79e-5f6d13aa2476 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:45.718696 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ff37733b-39de-4d8b-b79e-5f6d13aa2476 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:45.719148 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ff37733b-39de-4d8b-b79e-5f6d13aa2476 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:45.721309 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ff37733b-39de-4d8b-b79e-5f6d13aa2476 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:45.721309 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ff37733b-39de-4d8b-b79e-5f6d13aa2476 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:45.721309 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ff37733b-39de-4d8b-b79e-5f6d13aa2476 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:45.937507 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ff37733b-39de-4d8b-b79e-5f6d13aa2476 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:45.989944 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ff37733b-39de-4d8b-b79e-5f6d13aa2476 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1201 microversion: 2.1 time: 0.293774 Aug 05 07:20:45.990555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 335/662] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:45 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1201 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:46.355871 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-725482466", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5cb1f597-6366-4fa9-b689-ca18264fbf89"}], "security_groups": [{"name": "tempest-securitygroup--680833316"}], "key_name": "tempest-keypair-1721325610", "user_data": "}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:46.603422 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] validate_networks() for [('5cb1f597-6366-4fa9-b689-ca18264fbf89', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:20:46.661460 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1213778676", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94bcede7-f992-4709-94b9-11856148fea6"}], "security_groups": [{"name": "tempest-securitygroup--1671889233"}], "key_name": "tempest-keypair-1542233691", "user_data": "}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:46.795348 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] validate_networks() for [('94bcede7-f992-4709-94b9-11856148fea6', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:20:47.455854 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:20:47.456646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:20:47.457861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:20:47.458548 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:20:47.459908 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:20:47.471170 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:47.471973 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:47.472404 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:47.473210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:47.473662 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:47.474080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:47.498982 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Getting quotas for project 92e23c5c336e486f995f88c12b72b2c5. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:20:47.505493 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Getting quotas for user 02c685b300874351ab2dbd62bea1a669 and project 92e23c5c336e486f995f88c12b72b2c5. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:20:47.521007 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:20:47.523597 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:20:47.582298 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-53fb92a5-1928-4deb-869a-cae31d7295c9 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.925183 Aug 05 07:20:47.589423 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 336/663] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:20:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 07:20:47.595299 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f6745842-5d5a-4eec-beaf-764f5b59b80d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:47.595932 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f6745842-5d5a-4eec-beaf-764f5b59b80d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:47.603315 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f6745842-5d5a-4eec-beaf-764f5b59b80d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:47.603815 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f6745842-5d5a-4eec-beaf-764f5b59b80d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:47.604245 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f6745842-5d5a-4eec-beaf-764f5b59b80d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:47.605127 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f6745842-5d5a-4eec-beaf-764f5b59b80d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:47.605610 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f6745842-5d5a-4eec-beaf-764f5b59b80d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:47.606496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f6745842-5d5a-4eec-beaf-764f5b59b80d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:47.739739 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f6745842-5d5a-4eec-beaf-764f5b59b80d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:47.763043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f6745842-5d5a-4eec-beaf-764f5b59b80d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1199 microversion: 2.1 time: 0.171038 Aug 05 07:20:47.764820 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 337/664] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:47 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1199 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:47.808020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-758d62a0-8990-4c42-b268-20801a6efaf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:47.809155 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-758d62a0-8990-4c42-b268-20801a6efaf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:47.886691 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-758d62a0-8990-4c42-b268-20801a6efaf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:47.895383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-758d62a0-8990-4c42-b268-20801a6efaf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1238 microversion: 2.1 time: 0.098919 Aug 05 07:20:47.901782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 338/665] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:47 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1238 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:47.941329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:20:47.943327 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:20:47.948331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:20:47.951450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:20:47.952418 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:20:47.994778 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:47.995428 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:47.995964 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:47.996828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:47.997422 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:47.997943 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:48.031078 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Getting quotas for project f3385eb4afc441ba834ec0ddc1c3fd9a. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:20:48.036955 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Getting quotas for user 723cdd3baceb4f51a57df4863af99c3e and project f3385eb4afc441ba834ec0ddc1c3fd9a. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:20:48.067234 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:20:48.070221 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:20:48.154286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7e306f40-2a93-4ddc-b066-1acb7f756537 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.800468 Aug 05 07:20:48.156252 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 328/666] 10.222.0.27 () {62 vars in 1188 bytes} [Fri Aug 5 07:20:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 07:20:48.298853 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ad97b875-6f92-4ae3-9c60-f2a617aa0f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:48.299212 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ad97b875-6f92-4ae3-9c60-f2a617aa0f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:48.374836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ad97b875-6f92-4ae3-9c60-f2a617aa0f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:48.384594 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ad97b875-6f92-4ae3-9c60-f2a617aa0f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:48.395087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ad97b875-6f92-4ae3-9c60-f2a617aa0f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:48.396658 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ad97b875-6f92-4ae3-9c60-f2a617aa0f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1281 microversion: 2.20 time: 0.227491 Aug 05 07:20:48.400655 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 339/667] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:48 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1281 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:48.803895 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a9e4f1b6-58da-403d-be24-ccab591a2e57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:48.804532 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a9e4f1b6-58da-403d-be24-ccab591a2e57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:48.813841 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e4f1b6-58da-403d-be24-ccab591a2e57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:48.813841 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e4f1b6-58da-403d-be24-ccab591a2e57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:48.814656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e4f1b6-58da-403d-be24-ccab591a2e57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:48.815063 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e4f1b6-58da-403d-be24-ccab591a2e57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:48.815732 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e4f1b6-58da-403d-be24-ccab591a2e57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:48.816373 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e4f1b6-58da-403d-be24-ccab591a2e57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:48.917789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e3d1632a-10a1-4e80-9ae7-81c38ca98929 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:48.919696 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e3d1632a-10a1-4e80-9ae7-81c38ca98929 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:48.927644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e3d1632a-10a1-4e80-9ae7-81c38ca98929 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:48.928169 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e3d1632a-10a1-4e80-9ae7-81c38ca98929 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:48.928660 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e3d1632a-10a1-4e80-9ae7-81c38ca98929 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:48.929642 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e3d1632a-10a1-4e80-9ae7-81c38ca98929 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:48.930283 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e3d1632a-10a1-4e80-9ae7-81c38ca98929 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:48.930928 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e3d1632a-10a1-4e80-9ae7-81c38ca98929 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:49.011981 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e3d1632a-10a1-4e80-9ae7-81c38ca98929 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:49.025847 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e3d1632a-10a1-4e80-9ae7-81c38ca98929 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1290 microversion: 2.1 time: 0.110841 Aug 05 07:20:49.026821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 340/668] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:48 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1290 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:49.246711 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a9e4f1b6-58da-403d-be24-ccab591a2e57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:49.279688 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a9e4f1b6-58da-403d-be24-ccab591a2e57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.480949 Aug 05 07:20:49.282193 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 329/669] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:48 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:49.445062 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-21328543-a681-4c78-9bfe-5a73fd635fda tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:49.445749 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-21328543-a681-4c78-9bfe-5a73fd635fda tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:49.454166 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-21328543-a681-4c78-9bfe-5a73fd635fda tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:49.455050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-21328543-a681-4c78-9bfe-5a73fd635fda tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:49.455688 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-21328543-a681-4c78-9bfe-5a73fd635fda tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:49.456716 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-21328543-a681-4c78-9bfe-5a73fd635fda tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:49.457337 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-21328543-a681-4c78-9bfe-5a73fd635fda tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:49.457785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-21328543-a681-4c78-9bfe-5a73fd635fda tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:49.542870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-21328543-a681-4c78-9bfe-5a73fd635fda tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:49.558269 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-21328543-a681-4c78-9bfe-5a73fd635fda tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:49.558269 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-21328543-a681-4c78-9bfe-5a73fd635fda tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:49.561881 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-21328543-a681-4c78-9bfe-5a73fd635fda tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1333 microversion: 2.20 time: 0.120518 Aug 05 07:20:49.563334 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 341/670] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:49 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1333 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:50.063171 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9a2fe5bc-7dfc-4391-8447-bf92836f1cac tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:50.064727 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9a2fe5bc-7dfc-4391-8447-bf92836f1cac tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:50.086656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a2fe5bc-7dfc-4391-8447-bf92836f1cac tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:50.089343 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a2fe5bc-7dfc-4391-8447-bf92836f1cac tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:50.090544 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a2fe5bc-7dfc-4391-8447-bf92836f1cac tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:50.092614 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a2fe5bc-7dfc-4391-8447-bf92836f1cac tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:50.095428 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a2fe5bc-7dfc-4391-8447-bf92836f1cac tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:50.097343 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9a2fe5bc-7dfc-4391-8447-bf92836f1cac tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:50.262069 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9a2fe5bc-7dfc-4391-8447-bf92836f1cac tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:50.276154 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9a2fe5bc-7dfc-4391-8447-bf92836f1cac tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1296 microversion: 2.1 time: 0.225793 Aug 05 07:20:50.277372 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 330/671] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:50 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1296 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:50.316420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c31c953f-e9a9-4aa0-acdf-0c9750ab5417 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:50.317726 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c31c953f-e9a9-4aa0-acdf-0c9750ab5417 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:50.322811 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-94f9de45-871a-4293-98c8-196d17d98117 req-e7026263-6375-4568-8f2d-ca378b68443b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2739a6-db43-428a-9342-53229c6530fb", "tag": "f7adc9e7-faaa-401c-97e8-c38dbcabbbf9"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:50.339531 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c31c953f-e9a9-4aa0-acdf-0c9750ab5417 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:50.340389 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c31c953f-e9a9-4aa0-acdf-0c9750ab5417 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:50.341128 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c31c953f-e9a9-4aa0-acdf-0c9750ab5417 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:50.341571 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-94f9de45-871a-4293-98c8-196d17d98117 req-e7026263-6375-4568-8f2d-ca378b68443b service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:50.342640 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-94f9de45-871a-4293-98c8-196d17d98117 req-e7026263-6375-4568-8f2d-ca378b68443b service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:50.343047 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c31c953f-e9a9-4aa0-acdf-0c9750ab5417 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:50.343877 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-94f9de45-871a-4293-98c8-196d17d98117 req-e7026263-6375-4568-8f2d-ca378b68443b service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:50.344927 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c31c953f-e9a9-4aa0-acdf-0c9750ab5417 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:50.346250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c31c953f-e9a9-4aa0-acdf-0c9750ab5417 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:50.368146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-94f9de45-871a-4293-98c8-196d17d98117 req-e7026263-6375-4568-8f2d-ca378b68443b service nova] Creating event network-changed:f7adc9e7-faaa-401c-97e8-c38dbcabbbf9 for instance 5b2739a6-db43-428a-9342-53229c6530fb on hv-cinder-85200 Aug 05 07:20:50.401290 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-94f9de45-871a-4293-98c8-196d17d98117 req-e7026263-6375-4568-8f2d-ca378b68443b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084898 Aug 05 07:20:50.404140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 331/672] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:50.600230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4ec326b5-4d92-46bb-9466-f7a520a02706 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:50.601231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4ec326b5-4d92-46bb-9466-f7a520a02706 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:50.614686 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ec326b5-4d92-46bb-9466-f7a520a02706 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:50.615761 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ec326b5-4d92-46bb-9466-f7a520a02706 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:50.630706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ec326b5-4d92-46bb-9466-f7a520a02706 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:50.632268 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ec326b5-4d92-46bb-9466-f7a520a02706 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:50.633137 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ec326b5-4d92-46bb-9466-f7a520a02706 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:50.633891 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ec326b5-4d92-46bb-9466-f7a520a02706 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:50.682268 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c31c953f-e9a9-4aa0-acdf-0c9750ab5417 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:50.698570 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c31c953f-e9a9-4aa0-acdf-0c9750ab5417 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.391050 Aug 05 07:20:50.699374 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 342/673] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:50 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:50.864334 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4ec326b5-4d92-46bb-9466-f7a520a02706 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:50.885256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4ec326b5-4d92-46bb-9466-f7a520a02706 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:50.890516 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4ec326b5-4d92-46bb-9466-f7a520a02706 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:50.893276 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4ec326b5-4d92-46bb-9466-f7a520a02706 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1339 microversion: 2.20 time: 0.297757 Aug 05 07:20:50.894385 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 332/674] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:50 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1339 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:51.312245 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c284ea4c-876d-49bc-9f9f-b5a7a3041a6d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:51.315803 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c284ea4c-876d-49bc-9f9f-b5a7a3041a6d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:51.327566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c284ea4c-876d-49bc-9f9f-b5a7a3041a6d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:51.329923 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c284ea4c-876d-49bc-9f9f-b5a7a3041a6d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:51.330778 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c284ea4c-876d-49bc-9f9f-b5a7a3041a6d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:51.332137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c284ea4c-876d-49bc-9f9f-b5a7a3041a6d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:51.333051 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c284ea4c-876d-49bc-9f9f-b5a7a3041a6d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:51.334093 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c284ea4c-876d-49bc-9f9f-b5a7a3041a6d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:51.522410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c284ea4c-876d-49bc-9f9f-b5a7a3041a6d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:51.536575 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c284ea4c-876d-49bc-9f9f-b5a7a3041a6d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1296 microversion: 2.1 time: 0.232095 Aug 05 07:20:51.538085 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 343/675] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:51 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1296 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:51.734373 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e983a5dc-7f11-4151-9831-2a4badaa74c0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:51.742812 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e983a5dc-7f11-4151-9831-2a4badaa74c0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:51.755315 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e983a5dc-7f11-4151-9831-2a4badaa74c0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:51.756096 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e983a5dc-7f11-4151-9831-2a4badaa74c0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:51.756743 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e983a5dc-7f11-4151-9831-2a4badaa74c0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:51.757994 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e983a5dc-7f11-4151-9831-2a4badaa74c0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:51.758641 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e983a5dc-7f11-4151-9831-2a4badaa74c0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:51.760326 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e983a5dc-7f11-4151-9831-2a4badaa74c0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:51.938070 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e0726c7d-6774-42ae-ae83-f050380bed64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:51.938550 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e0726c7d-6774-42ae-ae83-f050380bed64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:51.954921 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e0726c7d-6774-42ae-ae83-f050380bed64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:51.955423 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e0726c7d-6774-42ae-ae83-f050380bed64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:51.955867 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e0726c7d-6774-42ae-ae83-f050380bed64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:51.956609 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e0726c7d-6774-42ae-ae83-f050380bed64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:51.957105 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e0726c7d-6774-42ae-ae83-f050380bed64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:51.957748 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e0726c7d-6774-42ae-ae83-f050380bed64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:52.306924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e0726c7d-6774-42ae-ae83-f050380bed64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:52.327052 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e0726c7d-6774-42ae-ae83-f050380bed64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:52.331425 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e0726c7d-6774-42ae-ae83-f050380bed64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:52.335746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e0726c7d-6774-42ae-ae83-f050380bed64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1406 microversion: 2.20 time: 0.402925 Aug 05 07:20:52.337200 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 344/676] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:51 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:20:52.346791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-44004c40-509b-4315-9cf3-e5486a077103 req-c83864b6-b3b0-45b2-9303-2cc16bd56f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d197c94-dfa3-4fe2-974d-4134fb0cb595", "tag": "155ed77d-f493-45be-ad25-67f9052f1659"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:52.366588 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-44004c40-509b-4315-9cf3-e5486a077103 req-c83864b6-b3b0-45b2-9303-2cc16bd56f42 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:52.367430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-44004c40-509b-4315-9cf3-e5486a077103 req-c83864b6-b3b0-45b2-9303-2cc16bd56f42 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:52.368146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-44004c40-509b-4315-9cf3-e5486a077103 req-c83864b6-b3b0-45b2-9303-2cc16bd56f42 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:52.390582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-44004c40-509b-4315-9cf3-e5486a077103 req-c83864b6-b3b0-45b2-9303-2cc16bd56f42 service nova] Creating event network-changed:155ed77d-f493-45be-ad25-67f9052f1659 for instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 on hv-cinder-85200 Aug 05 07:20:52.400204 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-44004c40-509b-4315-9cf3-e5486a077103 req-c83864b6-b3b0-45b2-9303-2cc16bd56f42 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060423 Aug 05 07:20:52.401329 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 345/677] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:52.481294 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e983a5dc-7f11-4151-9831-2a4badaa74c0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:52.504351 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e983a5dc-7f11-4151-9831-2a4badaa74c0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.775460 Aug 05 07:20:52.508192 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 333/678] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:51 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:52.569123 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f23b6ba0-7379-4353-8927-7161aedf5b03 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:52.570772 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f23b6ba0-7379-4353-8927-7161aedf5b03 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:52.582654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f23b6ba0-7379-4353-8927-7161aedf5b03 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:52.583798 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f23b6ba0-7379-4353-8927-7161aedf5b03 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:52.584496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f23b6ba0-7379-4353-8927-7161aedf5b03 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:52.585651 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f23b6ba0-7379-4353-8927-7161aedf5b03 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:52.587166 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f23b6ba0-7379-4353-8927-7161aedf5b03 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:52.587860 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f23b6ba0-7379-4353-8927-7161aedf5b03 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:52.944002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f23b6ba0-7379-4353-8927-7161aedf5b03 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:52.956156 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f23b6ba0-7379-4353-8927-7161aedf5b03 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.393875 Aug 05 07:20:52.957198 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 346/679] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:52 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:53.360134 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b2e3ca68-d7c5-46ba-9579-b7fcf3748e23 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:53.361504 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b2e3ca68-d7c5-46ba-9579-b7fcf3748e23 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:53.373058 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2e3ca68-d7c5-46ba-9579-b7fcf3748e23 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:53.373841 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2e3ca68-d7c5-46ba-9579-b7fcf3748e23 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:53.374998 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2e3ca68-d7c5-46ba-9579-b7fcf3748e23 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:53.377525 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2e3ca68-d7c5-46ba-9579-b7fcf3748e23 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:53.378261 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2e3ca68-d7c5-46ba-9579-b7fcf3748e23 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:53.389766 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2e3ca68-d7c5-46ba-9579-b7fcf3748e23 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:53.538289 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-aa8e94c8-eb84-43e6-bc26-1e13b3fe8165 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:53.539314 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-aa8e94c8-eb84-43e6-bc26-1e13b3fe8165 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:53.549696 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-aa8e94c8-eb84-43e6-bc26-1e13b3fe8165 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:53.550354 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-aa8e94c8-eb84-43e6-bc26-1e13b3fe8165 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:53.550896 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-aa8e94c8-eb84-43e6-bc26-1e13b3fe8165 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:53.551850 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-aa8e94c8-eb84-43e6-bc26-1e13b3fe8165 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:53.552403 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-aa8e94c8-eb84-43e6-bc26-1e13b3fe8165 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:53.553101 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-aa8e94c8-eb84-43e6-bc26-1e13b3fe8165 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:53.824146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-aa8e94c8-eb84-43e6-bc26-1e13b3fe8165 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:53.833737 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-aa8e94c8-eb84-43e6-bc26-1e13b3fe8165 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.301107 Aug 05 07:20:53.834724 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 347/680] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:53 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:53.988226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-67decb03-9664-477e-8b80-35afaa3e4466 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:53.989836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-67decb03-9664-477e-8b80-35afaa3e4466 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:54.002001 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-67decb03-9664-477e-8b80-35afaa3e4466 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:54.002867 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-67decb03-9664-477e-8b80-35afaa3e4466 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:54.003625 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-67decb03-9664-477e-8b80-35afaa3e4466 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:54.004885 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-67decb03-9664-477e-8b80-35afaa3e4466 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:54.005843 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-67decb03-9664-477e-8b80-35afaa3e4466 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:54.006743 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-67decb03-9664-477e-8b80-35afaa3e4466 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:54.022508 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b2e3ca68-d7c5-46ba-9579-b7fcf3748e23 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:54.048689 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b2e3ca68-d7c5-46ba-9579-b7fcf3748e23 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:54.052154 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b2e3ca68-d7c5-46ba-9579-b7fcf3748e23 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:54.054351 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b2e3ca68-d7c5-46ba-9579-b7fcf3748e23 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1406 microversion: 2.20 time: 0.698059 Aug 05 07:20:54.055518 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 334/681] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:53 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1406 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:20:54.304174 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-67decb03-9664-477e-8b80-35afaa3e4466 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:54.319489 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-67decb03-9664-477e-8b80-35afaa3e4466 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.339256 Aug 05 07:20:54.320552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 348/682] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:53 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:20:54.429210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-3ea7a5ad-9104-41ba-8ce7-8d9cb0e2e2e8 req-31a42123-7db2-4a94-b256-5f0aef96e13e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd3c1c0-4733-45dc-ab55-794aa3ea12e9", "tag": "2fef8161-aaaa-4f88-9f08-285fe2c78aa5"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:54.447983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-3ea7a5ad-9104-41ba-8ce7-8d9cb0e2e2e8 req-31a42123-7db2-4a94-b256-5f0aef96e13e service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:54.450016 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-3ea7a5ad-9104-41ba-8ce7-8d9cb0e2e2e8 req-31a42123-7db2-4a94-b256-5f0aef96e13e service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:54.451235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-3ea7a5ad-9104-41ba-8ce7-8d9cb0e2e2e8 req-31a42123-7db2-4a94-b256-5f0aef96e13e service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:54.474479 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-3ea7a5ad-9104-41ba-8ce7-8d9cb0e2e2e8 req-31a42123-7db2-4a94-b256-5f0aef96e13e service nova] Creating event network-changed:2fef8161-aaaa-4f88-9f08-285fe2c78aa5 for instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 on hv-cinder-85200 Aug 05 07:20:54.484508 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-3ea7a5ad-9104-41ba-8ce7-8d9cb0e2e2e8 req-31a42123-7db2-4a94-b256-5f0aef96e13e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062041 Aug 05 07:20:54.487251 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 335/683] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:20:54.869215 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ffc8e38a-32c8-4d7d-be81-fc0ff773203a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:54.870436 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ffc8e38a-32c8-4d7d-be81-fc0ff773203a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:54.878149 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ffc8e38a-32c8-4d7d-be81-fc0ff773203a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:54.878782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ffc8e38a-32c8-4d7d-be81-fc0ff773203a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:54.879392 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ffc8e38a-32c8-4d7d-be81-fc0ff773203a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:54.880218 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ffc8e38a-32c8-4d7d-be81-fc0ff773203a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:54.880809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ffc8e38a-32c8-4d7d-be81-fc0ff773203a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:54.881348 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ffc8e38a-32c8-4d7d-be81-fc0ff773203a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:55.080815 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dd165e02-bd32-4fd5-8fbd-0e52a123a92a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:55.082080 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dd165e02-bd32-4fd5-8fbd-0e52a123a92a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:55.092134 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd165e02-bd32-4fd5-8fbd-0e52a123a92a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:55.093216 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd165e02-bd32-4fd5-8fbd-0e52a123a92a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:55.094019 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd165e02-bd32-4fd5-8fbd-0e52a123a92a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:55.095340 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd165e02-bd32-4fd5-8fbd-0e52a123a92a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:55.096687 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd165e02-bd32-4fd5-8fbd-0e52a123a92a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:55.097380 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd165e02-bd32-4fd5-8fbd-0e52a123a92a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:55.109083 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ffc8e38a-32c8-4d7d-be81-fc0ff773203a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:55.115002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:55.123238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ffc8e38a-32c8-4d7d-be81-fc0ff773203a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.258792 Aug 05 07:20:55.124573 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 349/684] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:54 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:55.326068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dd165e02-bd32-4fd5-8fbd-0e52a123a92a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:55.336401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dd165e02-bd32-4fd5-8fbd-0e52a123a92a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:55.339775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dd165e02-bd32-4fd5-8fbd-0e52a123a92a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:55.341769 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-dd165e02-bd32-4fd5-8fbd-0e52a123a92a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1406 microversion: 2.20 time: 0.266334 Aug 05 07:20:55.343241 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 336/685] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:55 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:20:55.345913 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a5aa0577-1bea-476c-bb0c-ee8cbc189a90 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:55.347097 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a5aa0577-1bea-476c-bb0c-ee8cbc189a90 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:55.355369 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a5aa0577-1bea-476c-bb0c-ee8cbc189a90 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:55.356056 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a5aa0577-1bea-476c-bb0c-ee8cbc189a90 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:55.356696 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a5aa0577-1bea-476c-bb0c-ee8cbc189a90 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:55.357597 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a5aa0577-1bea-476c-bb0c-ee8cbc189a90 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:55.358287 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a5aa0577-1bea-476c-bb0c-ee8cbc189a90 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:55.358900 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a5aa0577-1bea-476c-bb0c-ee8cbc189a90 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:55.569906 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a5aa0577-1bea-476c-bb0c-ee8cbc189a90 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:55.579428 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a5aa0577-1bea-476c-bb0c-ee8cbc189a90 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.240700 Aug 05 07:20:55.580099 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 350/686] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:55 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:56.154714 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bb84d38c-1d72-4fc5-9916-4e1e827c6c30 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:56.155550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bb84d38c-1d72-4fc5-9916-4e1e827c6c30 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:56.162566 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb84d38c-1d72-4fc5-9916-4e1e827c6c30 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:56.163062 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb84d38c-1d72-4fc5-9916-4e1e827c6c30 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:56.163494 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb84d38c-1d72-4fc5-9916-4e1e827c6c30 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:56.164208 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb84d38c-1d72-4fc5-9916-4e1e827c6c30 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:56.164662 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb84d38c-1d72-4fc5-9916-4e1e827c6c30 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:56.165121 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb84d38c-1d72-4fc5-9916-4e1e827c6c30 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:56.326735 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bb84d38c-1d72-4fc5-9916-4e1e827c6c30 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:56.335538 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bb84d38c-1d72-4fc5-9916-4e1e827c6c30 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.185244 Aug 05 07:20:56.336157 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 337/687] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:56 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:20:56.376290 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-dd3c254a-7cd2-4d4a-9d96-9408d3fbd956 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:56.377164 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-dd3c254a-7cd2-4d4a-9d96-9408d3fbd956 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:56.384626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dd3c254a-7cd2-4d4a-9d96-9408d3fbd956 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:56.385202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dd3c254a-7cd2-4d4a-9d96-9408d3fbd956 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:56.385860 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dd3c254a-7cd2-4d4a-9d96-9408d3fbd956 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:56.386769 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dd3c254a-7cd2-4d4a-9d96-9408d3fbd956 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:56.387302 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dd3c254a-7cd2-4d4a-9d96-9408d3fbd956 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:56.387800 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dd3c254a-7cd2-4d4a-9d96-9408d3fbd956 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:56.559846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-dd3c254a-7cd2-4d4a-9d96-9408d3fbd956 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:56.572287 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-dd3c254a-7cd2-4d4a-9d96-9408d3fbd956 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:56.575608 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-dd3c254a-7cd2-4d4a-9d96-9408d3fbd956 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:56.577565 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-dd3c254a-7cd2-4d4a-9d96-9408d3fbd956 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1406 microversion: 2.20 time: 0.205192 Aug 05 07:20:56.578598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 351/688] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:56 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:56.612500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d3a5b382-49db-4478-8d3a-8da1bd5563b3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:56.613578 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d3a5b382-49db-4478-8d3a-8da1bd5563b3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:56.621320 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d3a5b382-49db-4478-8d3a-8da1bd5563b3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:56.621952 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d3a5b382-49db-4478-8d3a-8da1bd5563b3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:56.622496 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d3a5b382-49db-4478-8d3a-8da1bd5563b3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:56.623442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d3a5b382-49db-4478-8d3a-8da1bd5563b3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:56.624084 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d3a5b382-49db-4478-8d3a-8da1bd5563b3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:56.624710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d3a5b382-49db-4478-8d3a-8da1bd5563b3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:56.903818 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d3a5b382-49db-4478-8d3a-8da1bd5563b3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:56.915210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d3a5b382-49db-4478-8d3a-8da1bd5563b3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.307534 Aug 05 07:20:56.916387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 338/689] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:56 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:57.367310 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b5296c6f-dcf2-4d25-b6cd-bd39531127bb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:57.368512 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b5296c6f-dcf2-4d25-b6cd-bd39531127bb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:57.384435 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b5296c6f-dcf2-4d25-b6cd-bd39531127bb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:57.387649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b5296c6f-dcf2-4d25-b6cd-bd39531127bb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:57.388946 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b5296c6f-dcf2-4d25-b6cd-bd39531127bb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:57.390488 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b5296c6f-dcf2-4d25-b6cd-bd39531127bb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:57.392534 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b5296c6f-dcf2-4d25-b6cd-bd39531127bb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:57.393782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b5296c6f-dcf2-4d25-b6cd-bd39531127bb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:57.489540 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=4 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:57.602661 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dafb639f-f612-4a48-b7a9-71c64fe086c1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:57.603982 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dafb639f-f612-4a48-b7a9-71c64fe086c1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:57.611327 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dafb639f-f612-4a48-b7a9-71c64fe086c1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:57.611809 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dafb639f-f612-4a48-b7a9-71c64fe086c1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:57.612235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dafb639f-f612-4a48-b7a9-71c64fe086c1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:57.612938 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dafb639f-f612-4a48-b7a9-71c64fe086c1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:57.613607 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dafb639f-f612-4a48-b7a9-71c64fe086c1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:57.614013 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dafb639f-f612-4a48-b7a9-71c64fe086c1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:57.680477 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b5296c6f-dcf2-4d25-b6cd-bd39531127bb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:57.695110 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b5296c6f-dcf2-4d25-b6cd-bd39531127bb tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.339598 Aug 05 07:20:57.696948 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 352/690] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:57 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:57.774703 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dafb639f-f612-4a48-b7a9-71c64fe086c1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:57.783920 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dafb639f-f612-4a48-b7a9-71c64fe086c1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:57.786206 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dafb639f-f612-4a48-b7a9-71c64fe086c1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:57.787625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-dafb639f-f612-4a48-b7a9-71c64fe086c1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1406 microversion: 2.20 time: 0.189073 Aug 05 07:20:57.788323 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 339/691] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:57 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:20:57.940547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b5391d4e-fb97-46cc-bf11-c60e36b71c57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:57.941236 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b5391d4e-fb97-46cc-bf11-c60e36b71c57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:57.948508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b5391d4e-fb97-46cc-bf11-c60e36b71c57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:57.949045 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b5391d4e-fb97-46cc-bf11-c60e36b71c57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:57.949489 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b5391d4e-fb97-46cc-bf11-c60e36b71c57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:57.950209 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b5391d4e-fb97-46cc-bf11-c60e36b71c57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:57.950666 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b5391d4e-fb97-46cc-bf11-c60e36b71c57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:57.951089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b5391d4e-fb97-46cc-bf11-c60e36b71c57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:58.123371 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b5391d4e-fb97-46cc-bf11-c60e36b71c57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:58.134700 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b5391d4e-fb97-46cc-bf11-c60e36b71c57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.198458 Aug 05 07:20:58.135575 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 353/692] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:57 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:58.719949 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-af6e0483-2577-426e-839c-0424eb88640e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:58.721264 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-af6e0483-2577-426e-839c-0424eb88640e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:58.723678 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:58.725747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=16 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:58.734868 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-af6e0483-2577-426e-839c-0424eb88640e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:58.735517 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-af6e0483-2577-426e-839c-0424eb88640e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:58.736031 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-af6e0483-2577-426e-839c-0424eb88640e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:58.737099 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-af6e0483-2577-426e-839c-0424eb88640e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:58.737751 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-af6e0483-2577-426e-839c-0424eb88640e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:58.738264 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-af6e0483-2577-426e-839c-0424eb88640e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:58.825015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4818e9d0-bd3a-4a2d-ac89-b1491a637201 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:58.828210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4818e9d0-bd3a-4a2d-ac89-b1491a637201 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:58.832971 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=16 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:58.841819 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4818e9d0-bd3a-4a2d-ac89-b1491a637201 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:58.842623 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4818e9d0-bd3a-4a2d-ac89-b1491a637201 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:58.843383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4818e9d0-bd3a-4a2d-ac89-b1491a637201 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:58.844547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4818e9d0-bd3a-4a2d-ac89-b1491a637201 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:58.845340 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4818e9d0-bd3a-4a2d-ac89-b1491a637201 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:58.846003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4818e9d0-bd3a-4a2d-ac89-b1491a637201 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:58.978230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-af6e0483-2577-426e-839c-0424eb88640e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:58.994491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-af6e0483-2577-426e-839c-0424eb88640e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.278563 Aug 05 07:20:58.996331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 340/693] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:58 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:20:59.034055 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4818e9d0-bd3a-4a2d-ac89-b1491a637201 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:59.043390 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4818e9d0-bd3a-4a2d-ac89-b1491a637201 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:59.045014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4818e9d0-bd3a-4a2d-ac89-b1491a637201 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:59.046290 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4818e9d0-bd3a-4a2d-ac89-b1491a637201 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1406 microversion: 2.20 time: 0.228024 Aug 05 07:20:59.046875 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 354/694] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:20:58 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:20:59.170373 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9e307360-9cf6-4dd9-a5ee-a638db56f000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:20:59.171270 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9e307360-9cf6-4dd9-a5ee-a638db56f000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:20:59.178504 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e307360-9cf6-4dd9-a5ee-a638db56f000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:59.179100 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e307360-9cf6-4dd9-a5ee-a638db56f000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:59.180990 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e307360-9cf6-4dd9-a5ee-a638db56f000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:59.182065 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e307360-9cf6-4dd9-a5ee-a638db56f000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:59.182590 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e307360-9cf6-4dd9-a5ee-a638db56f000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:59.183179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e307360-9cf6-4dd9-a5ee-a638db56f000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:59.394905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9e307360-9cf6-4dd9-a5ee-a638db56f000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:20:59.411787 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9e307360-9cf6-4dd9-a5ee-a638db56f000 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.245251 Aug 05 07:20:59.413785 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 341/695] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:20:59 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:20:59.440370 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-9894e7a2-60a0-4ee4-89e2-91a277b0e4ea req-c5e8ac1f-aa98-4b20-a6dd-f19adc092736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d197c94-dfa3-4fe2-974d-4134fb0cb595", "name": "network-vif-plugged", "status": "completed", "tag": "155ed77d-f493-45be-ad25-67f9052f1659"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:20:59.459619 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9894e7a2-60a0-4ee4-89e2-91a277b0e4ea req-c5e8ac1f-aa98-4b20-a6dd-f19adc092736 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:20:59.460961 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9894e7a2-60a0-4ee4-89e2-91a277b0e4ea req-c5e8ac1f-aa98-4b20-a6dd-f19adc092736 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:20:59.462169 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-9894e7a2-60a0-4ee4-89e2-91a277b0e4ea req-c5e8ac1f-aa98-4b20-a6dd-f19adc092736 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:20:59.486056 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-9894e7a2-60a0-4ee4-89e2-91a277b0e4ea req-c5e8ac1f-aa98-4b20-a6dd-f19adc092736 service nova] Creating event network-vif-plugged:155ed77d-f493-45be-ad25-67f9052f1659 for instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 on hv-cinder-85200 Aug 05 07:20:59.493133 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-9894e7a2-60a0-4ee4-89e2-91a277b0e4ea req-c5e8ac1f-aa98-4b20-a6dd-f19adc092736 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069300 Aug 05 07:20:59.494050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 355/696] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:00.021721 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9e426195-cb31-448f-bf02-f2d9b3096d0a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:00.022551 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9e426195-cb31-448f-bf02-f2d9b3096d0a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:00.031845 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e426195-cb31-448f-bf02-f2d9b3096d0a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:00.032318 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e426195-cb31-448f-bf02-f2d9b3096d0a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:00.032826 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e426195-cb31-448f-bf02-f2d9b3096d0a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:00.033679 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e426195-cb31-448f-bf02-f2d9b3096d0a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:00.034125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e426195-cb31-448f-bf02-f2d9b3096d0a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:00.034552 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e426195-cb31-448f-bf02-f2d9b3096d0a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:00.075626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7e066695-fb94-4afb-95fc-816d5e8a7723 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:00.076888 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7e066695-fb94-4afb-95fc-816d5e8a7723 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:00.088554 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7e066695-fb94-4afb-95fc-816d5e8a7723 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:00.089853 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7e066695-fb94-4afb-95fc-816d5e8a7723 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:00.090640 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7e066695-fb94-4afb-95fc-816d5e8a7723 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:00.091935 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7e066695-fb94-4afb-95fc-816d5e8a7723 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:00.092871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7e066695-fb94-4afb-95fc-816d5e8a7723 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:00.093598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7e066695-fb94-4afb-95fc-816d5e8a7723 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:00.215502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9e426195-cb31-448f-bf02-f2d9b3096d0a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:00.224238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9e426195-cb31-448f-bf02-f2d9b3096d0a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.210005 Aug 05 07:21:00.224851 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 342/697] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:00 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:00.303689 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7e066695-fb94-4afb-95fc-816d5e8a7723 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:00.313417 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7e066695-fb94-4afb-95fc-816d5e8a7723 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:00.315004 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7e066695-fb94-4afb-95fc-816d5e8a7723 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:00.316229 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7e066695-fb94-4afb-95fc-816d5e8a7723 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1406 microversion: 2.20 time: 0.250112 Aug 05 07:21:00.316868 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 356/698] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:21:00 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:21:00.444317 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d61b882f-3cb5-4af7-ae34-b24819adb99b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:00.445032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d61b882f-3cb5-4af7-ae34-b24819adb99b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:00.451896 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d61b882f-3cb5-4af7-ae34-b24819adb99b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:00.452447 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d61b882f-3cb5-4af7-ae34-b24819adb99b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:00.452885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d61b882f-3cb5-4af7-ae34-b24819adb99b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:00.453651 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d61b882f-3cb5-4af7-ae34-b24819adb99b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:00.454111 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d61b882f-3cb5-4af7-ae34-b24819adb99b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:00.454547 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d61b882f-3cb5-4af7-ae34-b24819adb99b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:00.645542 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d61b882f-3cb5-4af7-ae34-b24819adb99b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:00.661443 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d61b882f-3cb5-4af7-ae34-b24819adb99b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.220837 Aug 05 07:21:00.662610 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 343/699] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:00 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:01.246666 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-82352d66-d02f-4e3f-9900-5fb71c868362 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:01.247607 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-82352d66-d02f-4e3f-9900-5fb71c868362 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:01.254982 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-82352d66-d02f-4e3f-9900-5fb71c868362 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:01.255472 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-82352d66-d02f-4e3f-9900-5fb71c868362 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:01.255912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-82352d66-d02f-4e3f-9900-5fb71c868362 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:01.256667 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-82352d66-d02f-4e3f-9900-5fb71c868362 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:01.257154 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-82352d66-d02f-4e3f-9900-5fb71c868362 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:01.257574 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-82352d66-d02f-4e3f-9900-5fb71c868362 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:01.344519 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6ad2bb7f-0eab-4452-b6be-187d013e126d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:01.345702 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6ad2bb7f-0eab-4452-b6be-187d013e126d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:01.357449 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ad2bb7f-0eab-4452-b6be-187d013e126d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:01.358245 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ad2bb7f-0eab-4452-b6be-187d013e126d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:01.358923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ad2bb7f-0eab-4452-b6be-187d013e126d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:01.360070 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ad2bb7f-0eab-4452-b6be-187d013e126d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:01.360885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ad2bb7f-0eab-4452-b6be-187d013e126d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:01.361818 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ad2bb7f-0eab-4452-b6be-187d013e126d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:01.369759 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:01.415551 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-82352d66-d02f-4e3f-9900-5fb71c868362 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:01.429401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-82352d66-d02f-4e3f-9900-5fb71c868362 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.186822 Aug 05 07:21:01.430426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 357/700] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:01 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:01.556705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6ad2bb7f-0eab-4452-b6be-187d013e126d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:01.566371 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6ad2bb7f-0eab-4452-b6be-187d013e126d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:01.567879 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6ad2bb7f-0eab-4452-b6be-187d013e126d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:01.569171 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6ad2bb7f-0eab-4452-b6be-187d013e126d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1406 microversion: 2.20 time: 0.232642 Aug 05 07:21:01.569855 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 344/701] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:21:01 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:21:01.687721 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-dc1a45af-807f-41d0-8d4a-9e830a2156b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:01.688792 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-dc1a45af-807f-41d0-8d4a-9e830a2156b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:01.702934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc1a45af-807f-41d0-8d4a-9e830a2156b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:01.703836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc1a45af-807f-41d0-8d4a-9e830a2156b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:01.704608 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc1a45af-807f-41d0-8d4a-9e830a2156b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:01.705997 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc1a45af-807f-41d0-8d4a-9e830a2156b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:01.706811 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc1a45af-807f-41d0-8d4a-9e830a2156b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:01.707449 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dc1a45af-807f-41d0-8d4a-9e830a2156b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:01.886120 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-dc1a45af-807f-41d0-8d4a-9e830a2156b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:01.895399 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-dc1a45af-807f-41d0-8d4a-9e830a2156b7 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.214898 Aug 05 07:21:01.895972 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 358/702] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:01 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:02.452622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d0ebb595-dbe0-440f-b1f0-11ec86c1259e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:02.453450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d0ebb595-dbe0-440f-b1f0-11ec86c1259e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:02.461213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0ebb595-dbe0-440f-b1f0-11ec86c1259e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:02.461962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0ebb595-dbe0-440f-b1f0-11ec86c1259e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:02.462367 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0ebb595-dbe0-440f-b1f0-11ec86c1259e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:02.463112 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0ebb595-dbe0-440f-b1f0-11ec86c1259e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:02.463578 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0ebb595-dbe0-440f-b1f0-11ec86c1259e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:02.463993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0ebb595-dbe0-440f-b1f0-11ec86c1259e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:02.606630 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c85d1b45-6c7d-4369-99c7-e4f7b1993e64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:02.607535 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c85d1b45-6c7d-4369-99c7-e4f7b1993e64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:02.615778 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c85d1b45-6c7d-4369-99c7-e4f7b1993e64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:02.616304 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c85d1b45-6c7d-4369-99c7-e4f7b1993e64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:02.617010 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c85d1b45-6c7d-4369-99c7-e4f7b1993e64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:02.617937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c85d1b45-6c7d-4369-99c7-e4f7b1993e64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:02.618632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c85d1b45-6c7d-4369-99c7-e4f7b1993e64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:02.619330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c85d1b45-6c7d-4369-99c7-e4f7b1993e64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:02.638284 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d0ebb595-dbe0-440f-b1f0-11ec86c1259e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:02.647146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d0ebb595-dbe0-440f-b1f0-11ec86c1259e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.198577 Aug 05 07:21:02.647733 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 345/703] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:02 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:02.793030 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c85d1b45-6c7d-4369-99c7-e4f7b1993e64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:02.803149 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c85d1b45-6c7d-4369-99c7-e4f7b1993e64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:02.805062 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c85d1b45-6c7d-4369-99c7-e4f7b1993e64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:02.806437 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c85d1b45-6c7d-4369-99c7-e4f7b1993e64 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1406 microversion: 2.20 time: 0.205555 Aug 05 07:21:02.807145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 359/704] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:21:02 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:21:02.927920 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6089fdfc-9af9-4d45-a306-557a8a9c5be3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:02.928588 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6089fdfc-9af9-4d45-a306-557a8a9c5be3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:02.935646 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6089fdfc-9af9-4d45-a306-557a8a9c5be3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:02.936124 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6089fdfc-9af9-4d45-a306-557a8a9c5be3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:02.936660 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6089fdfc-9af9-4d45-a306-557a8a9c5be3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:02.937500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6089fdfc-9af9-4d45-a306-557a8a9c5be3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:02.937986 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6089fdfc-9af9-4d45-a306-557a8a9c5be3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:02.938455 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6089fdfc-9af9-4d45-a306-557a8a9c5be3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:03.113755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6089fdfc-9af9-4d45-a306-557a8a9c5be3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:03.123098 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6089fdfc-9af9-4d45-a306-557a8a9c5be3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.199025 Aug 05 07:21:03.124127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 346/705] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:02 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:03.680639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f78d55f1-b8e5-4a86-8962-9e139a68029d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:03.681786 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f78d55f1-b8e5-4a86-8962-9e139a68029d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:03.690486 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f78d55f1-b8e5-4a86-8962-9e139a68029d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:03.691060 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f78d55f1-b8e5-4a86-8962-9e139a68029d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:03.691622 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f78d55f1-b8e5-4a86-8962-9e139a68029d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:03.692401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f78d55f1-b8e5-4a86-8962-9e139a68029d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:03.692937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f78d55f1-b8e5-4a86-8962-9e139a68029d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:03.693675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f78d55f1-b8e5-4a86-8962-9e139a68029d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:03.830749 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8bbb3994-44d4-4745-bc73-fb9d4e2c8920 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:03.831652 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8bbb3994-44d4-4745-bc73-fb9d4e2c8920 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:03.841042 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8bbb3994-44d4-4745-bc73-fb9d4e2c8920 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:03.841509 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8bbb3994-44d4-4745-bc73-fb9d4e2c8920 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:03.841945 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8bbb3994-44d4-4745-bc73-fb9d4e2c8920 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:03.843232 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8bbb3994-44d4-4745-bc73-fb9d4e2c8920 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:03.843491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8bbb3994-44d4-4745-bc73-fb9d4e2c8920 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:03.843841 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8bbb3994-44d4-4745-bc73-fb9d4e2c8920 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:03.875031 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f78d55f1-b8e5-4a86-8962-9e139a68029d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:03.888427 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f78d55f1-b8e5-4a86-8962-9e139a68029d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.211987 Aug 05 07:21:03.889787 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 360/706] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:03 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:04.020176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8bbb3994-44d4-4745-bc73-fb9d4e2c8920 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:04.038865 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8bbb3994-44d4-4745-bc73-fb9d4e2c8920 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:04.041434 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8bbb3994-44d4-4745-bc73-fb9d4e2c8920 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:04.043744 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8bbb3994-44d4-4745-bc73-fb9d4e2c8920 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1406 microversion: 2.20 time: 0.217053 Aug 05 07:21:04.046093 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 347/707] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:21:03 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:21:04.154296 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-97d95bbe-dd9d-454e-bb11-af42f2d5625a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:04.155521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-97d95bbe-dd9d-454e-bb11-af42f2d5625a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:04.164838 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:04.167861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-97d95bbe-dd9d-454e-bb11-af42f2d5625a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:04.168734 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-97d95bbe-dd9d-454e-bb11-af42f2d5625a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:04.169781 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-97d95bbe-dd9d-454e-bb11-af42f2d5625a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:04.171375 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-97d95bbe-dd9d-454e-bb11-af42f2d5625a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:04.172386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-97d95bbe-dd9d-454e-bb11-af42f2d5625a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:04.173394 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-97d95bbe-dd9d-454e-bb11-af42f2d5625a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:04.390224 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-97d95bbe-dd9d-454e-bb11-af42f2d5625a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:04.399271 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-97d95bbe-dd9d-454e-bb11-af42f2d5625a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.254519 Aug 05 07:21:04.399877 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 361/708] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:04 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:21:04.918204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b6ed4610-3974-44bf-988d-5bad2ba31d61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:04.919498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b6ed4610-3974-44bf-988d-5bad2ba31d61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:04.931131 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6ed4610-3974-44bf-988d-5bad2ba31d61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:04.932002 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6ed4610-3974-44bf-988d-5bad2ba31d61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:04.932794 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6ed4610-3974-44bf-988d-5bad2ba31d61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:04.934122 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6ed4610-3974-44bf-988d-5bad2ba31d61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:04.934930 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6ed4610-3974-44bf-988d-5bad2ba31d61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:04.935744 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b6ed4610-3974-44bf-988d-5bad2ba31d61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:05.072357 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0d462777-22d2-498f-a996-1eaf91fe43d6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:05.073789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0d462777-22d2-498f-a996-1eaf91fe43d6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:05.086351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0d462777-22d2-498f-a996-1eaf91fe43d6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:05.087218 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0d462777-22d2-498f-a996-1eaf91fe43d6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:05.087956 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0d462777-22d2-498f-a996-1eaf91fe43d6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:05.089279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0d462777-22d2-498f-a996-1eaf91fe43d6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:05.090120 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0d462777-22d2-498f-a996-1eaf91fe43d6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:05.090854 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0d462777-22d2-498f-a996-1eaf91fe43d6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:05.203353 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b6ed4610-3974-44bf-988d-5bad2ba31d61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:05.217674 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b6ed4610-3974-44bf-988d-5bad2ba31d61 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.309100 Aug 05 07:21:05.218807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 348/709] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:04 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:05.289282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0d462777-22d2-498f-a996-1eaf91fe43d6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:05.298698 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0d462777-22d2-498f-a996-1eaf91fe43d6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:05.300359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0d462777-22d2-498f-a996-1eaf91fe43d6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:05.301736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0d462777-22d2-498f-a996-1eaf91fe43d6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1406 microversion: 2.20 time: 0.237347 Aug 05 07:21:05.302394 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 362/710] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:21:05 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:21:05.439285 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bf3d1b01-d62e-4ad4-af35-573b5ef86563 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:05.440298 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bf3d1b01-d62e-4ad4-af35-573b5ef86563 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:05.451309 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bf3d1b01-d62e-4ad4-af35-573b5ef86563 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:05.452163 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bf3d1b01-d62e-4ad4-af35-573b5ef86563 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:05.452952 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bf3d1b01-d62e-4ad4-af35-573b5ef86563 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:05.454189 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bf3d1b01-d62e-4ad4-af35-573b5ef86563 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:05.455006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bf3d1b01-d62e-4ad4-af35-573b5ef86563 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:05.455711 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bf3d1b01-d62e-4ad4-af35-573b5ef86563 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:05.618871 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bf3d1b01-d62e-4ad4-af35-573b5ef86563 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:05.627290 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bf3d1b01-d62e-4ad4-af35-573b5ef86563 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.195766 Aug 05 07:21:05.628259 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 349/711] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:05 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:06.165232 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-d9acc962-b98b-415d-afd2-60f2909b7546 req-1f170166-8e2b-4241-9ea6-1c6a570727bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd3c1c0-4733-45dc-ab55-794aa3ea12e9", "name": "network-vif-plugged", "status": "completed", "tag": "2fef8161-aaaa-4f88-9f08-285fe2c78aa5"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:06.189202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-d9acc962-b98b-415d-afd2-60f2909b7546 req-1f170166-8e2b-4241-9ea6-1c6a570727bb service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:06.190210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-d9acc962-b98b-415d-afd2-60f2909b7546 req-1f170166-8e2b-4241-9ea6-1c6a570727bb service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:06.191137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-d9acc962-b98b-415d-afd2-60f2909b7546 req-1f170166-8e2b-4241-9ea6-1c6a570727bb service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:06.215341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-d9acc962-b98b-415d-afd2-60f2909b7546 req-1f170166-8e2b-4241-9ea6-1c6a570727bb service nova] Creating event network-vif-plugged:2fef8161-aaaa-4f88-9f08-285fe2c78aa5 for instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 on hv-cinder-85200 Aug 05 07:21:06.225013 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-d9acc962-b98b-415d-afd2-60f2909b7546 req-1f170166-8e2b-4241-9ea6-1c6a570727bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066632 Aug 05 07:21:06.226347 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 363/712] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:06.245840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-df564911-48f8-484d-8a2e-5c786c45c468 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:06.245840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-df564911-48f8-484d-8a2e-5c786c45c468 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:06.253467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df564911-48f8-484d-8a2e-5c786c45c468 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:06.254625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df564911-48f8-484d-8a2e-5c786c45c468 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:06.254625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df564911-48f8-484d-8a2e-5c786c45c468 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:06.255740 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df564911-48f8-484d-8a2e-5c786c45c468 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:06.256181 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df564911-48f8-484d-8a2e-5c786c45c468 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:06.256806 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df564911-48f8-484d-8a2e-5c786c45c468 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:06.370954 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f4a95b1b-bda7-4272-a386-5f666c527f3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:06.374376 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f4a95b1b-bda7-4272-a386-5f666c527f3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:06.390634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f4a95b1b-bda7-4272-a386-5f666c527f3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:06.393371 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f4a95b1b-bda7-4272-a386-5f666c527f3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:06.394727 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f4a95b1b-bda7-4272-a386-5f666c527f3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:06.396472 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f4a95b1b-bda7-4272-a386-5f666c527f3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:06.397619 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f4a95b1b-bda7-4272-a386-5f666c527f3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:06.400085 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f4a95b1b-bda7-4272-a386-5f666c527f3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:06.538591 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-df564911-48f8-484d-8a2e-5c786c45c468 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:06.553966 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-df564911-48f8-484d-8a2e-5c786c45c468 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.313702 Aug 05 07:21:06.555602 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 350/713] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:06 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:06.637804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f4a95b1b-bda7-4272-a386-5f666c527f3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:06.647719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f4a95b1b-bda7-4272-a386-5f666c527f3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:06.649497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f4a95b1b-bda7-4272-a386-5f666c527f3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:06.650937 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a0b7edac-88aa-43c7-95fb-6ce07518073b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:06.651399 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f4a95b1b-bda7-4272-a386-5f666c527f3f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1406 microversion: 2.20 time: 0.306429 Aug 05 07:21:06.651770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a0b7edac-88aa-43c7-95fb-6ce07518073b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:06.652198 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 364/714] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:21:06 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:21:06.659561 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0b7edac-88aa-43c7-95fb-6ce07518073b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:06.660249 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0b7edac-88aa-43c7-95fb-6ce07518073b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:06.660797 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0b7edac-88aa-43c7-95fb-6ce07518073b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:06.661632 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0b7edac-88aa-43c7-95fb-6ce07518073b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:06.662156 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0b7edac-88aa-43c7-95fb-6ce07518073b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:06.662728 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0b7edac-88aa-43c7-95fb-6ce07518073b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:06.857685 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0b7edac-88aa-43c7-95fb-6ce07518073b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:06.866917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a0b7edac-88aa-43c7-95fb-6ce07518073b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.220876 Aug 05 07:21:06.867749 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 351/715] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:06 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:21:07.585345 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a11c5677-b75d-4503-9628-8751855681dd tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:07.586506 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a11c5677-b75d-4503-9628-8751855681dd tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:07.599297 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a11c5677-b75d-4503-9628-8751855681dd tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:07.600132 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a11c5677-b75d-4503-9628-8751855681dd tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:07.600820 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a11c5677-b75d-4503-9628-8751855681dd tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:07.602134 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a11c5677-b75d-4503-9628-8751855681dd tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:07.602886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a11c5677-b75d-4503-9628-8751855681dd tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:07.603560 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a11c5677-b75d-4503-9628-8751855681dd tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:07.693465 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-47a2efe7-2af9-4bdf-a9be-0b2f86f8e733 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:07.694777 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-47a2efe7-2af9-4bdf-a9be-0b2f86f8e733 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:07.706398 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-47a2efe7-2af9-4bdf-a9be-0b2f86f8e733 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:07.707257 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-47a2efe7-2af9-4bdf-a9be-0b2f86f8e733 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:07.708334 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-47a2efe7-2af9-4bdf-a9be-0b2f86f8e733 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:07.709664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-47a2efe7-2af9-4bdf-a9be-0b2f86f8e733 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:07.710437 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-47a2efe7-2af9-4bdf-a9be-0b2f86f8e733 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:07.711140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-47a2efe7-2af9-4bdf-a9be-0b2f86f8e733 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:07.817563 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a11c5677-b75d-4503-9628-8751855681dd tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:07.833441 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a11c5677-b75d-4503-9628-8751855681dd tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.254204 Aug 05 07:21:07.834723 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 365/716] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:07 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:07.923841 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-600e068a-be09-4f11-9340-ef36e82f09a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:07.925564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-600e068a-be09-4f11-9340-ef36e82f09a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:07.941413 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-600e068a-be09-4f11-9340-ef36e82f09a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:07.942507 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-600e068a-be09-4f11-9340-ef36e82f09a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:07.943345 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-600e068a-be09-4f11-9340-ef36e82f09a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:07.944701 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-600e068a-be09-4f11-9340-ef36e82f09a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:07.945688 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-600e068a-be09-4f11-9340-ef36e82f09a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:07.947222 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-600e068a-be09-4f11-9340-ef36e82f09a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:08.191449 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-600e068a-be09-4f11-9340-ef36e82f09a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:08.208937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-600e068a-be09-4f11-9340-ef36e82f09a1 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1364 microversion: 2.1 time: 0.301490 Aug 05 07:21:08.210205 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 366/717] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:07 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:08.251155 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-308e4ef5-a372-4175-9c74-3f313bb3003a req-049d073b-c40e-4e78-bfa5-dc8e2594f21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2739a6-db43-428a-9342-53229c6530fb", "name": "network-vif-plugged", "status": "completed", "tag": "f7adc9e7-faaa-401c-97e8-c38dbcabbbf9"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:08.272438 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-308e4ef5-a372-4175-9c74-3f313bb3003a req-049d073b-c40e-4e78-bfa5-dc8e2594f21d service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:08.273534 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-308e4ef5-a372-4175-9c74-3f313bb3003a req-049d073b-c40e-4e78-bfa5-dc8e2594f21d service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:08.274335 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-308e4ef5-a372-4175-9c74-3f313bb3003a req-049d073b-c40e-4e78-bfa5-dc8e2594f21d service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:08.297875 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-308e4ef5-a372-4175-9c74-3f313bb3003a req-049d073b-c40e-4e78-bfa5-dc8e2594f21d service nova] Creating event network-vif-plugged:f7adc9e7-faaa-401c-97e8-c38dbcabbbf9 for instance 5b2739a6-db43-428a-9342-53229c6530fb on hv-cinder-85200 Aug 05 07:21:08.307535 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-308e4ef5-a372-4175-9c74-3f313bb3003a req-049d073b-c40e-4e78-bfa5-dc8e2594f21d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063136 Aug 05 07:21:08.309427 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 367/718] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:08.310000 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-47a2efe7-2af9-4bdf-a9be-0b2f86f8e733 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:08.322957 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-47a2efe7-2af9-4bdf-a9be-0b2f86f8e733 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:08.324714 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-47a2efe7-2af9-4bdf-a9be-0b2f86f8e733 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:08.326288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-47a2efe7-2af9-4bdf-a9be-0b2f86f8e733 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1599 microversion: 2.20 time: 0.641126 Aug 05 07:21:08.327125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 352/719] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:21:07 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1599 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:21:08.367327 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9be35425-4e3b-4a0b-a3b1-79d004bdb5c3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:08.368049 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9be35425-4e3b-4a0b-a3b1-79d004bdb5c3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:08.384157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9be35425-4e3b-4a0b-a3b1-79d004bdb5c3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:08.385250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9be35425-4e3b-4a0b-a3b1-79d004bdb5c3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:08.385825 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9be35425-4e3b-4a0b-a3b1-79d004bdb5c3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:08.387841 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9be35425-4e3b-4a0b-a3b1-79d004bdb5c3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:08.389494 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9be35425-4e3b-4a0b-a3b1-79d004bdb5c3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:08.390405 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9be35425-4e3b-4a0b-a3b1-79d004bdb5c3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:08.421783 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:08.528983 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9be35425-4e3b-4a0b-a3b1-79d004bdb5c3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.169101 Aug 05 07:21:08.530260 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 368/720] 10.222.0.27 () {60 vars in 1316 bytes} [Fri Aug 5 07:21:08 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:21:08.866820 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-821c48a1-50db-49ac-b483-7b639d7fbcd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:08.867571 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-821c48a1-50db-49ac-b483-7b639d7fbcd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:08.875010 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-821c48a1-50db-49ac-b483-7b639d7fbcd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:08.875626 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-821c48a1-50db-49ac-b483-7b639d7fbcd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:08.876136 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-821c48a1-50db-49ac-b483-7b639d7fbcd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:08.877040 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-821c48a1-50db-49ac-b483-7b639d7fbcd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:08.877820 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-821c48a1-50db-49ac-b483-7b639d7fbcd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:08.878485 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-821c48a1-50db-49ac-b483-7b639d7fbcd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:09.186243 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-821c48a1-50db-49ac-b483-7b639d7fbcd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:09.205705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-821c48a1-50db-49ac-b483-7b639d7fbcd0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.341895 Aug 05 07:21:09.210757 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 353/721] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:08 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:09.245926 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-bb582816-bd9a-4d0e-be84-56eea7722566 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:09.247766 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-bb582816-bd9a-4d0e-be84-56eea7722566 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:09.263342 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bb582816-bd9a-4d0e-be84-56eea7722566 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:09.264739 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bb582816-bd9a-4d0e-be84-56eea7722566 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:09.266328 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bb582816-bd9a-4d0e-be84-56eea7722566 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:09.267844 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bb582816-bd9a-4d0e-be84-56eea7722566 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:09.269018 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bb582816-bd9a-4d0e-be84-56eea7722566 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:09.269748 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bb582816-bd9a-4d0e-be84-56eea7722566 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:09.587848 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-bb582816-bd9a-4d0e-be84-56eea7722566 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:09.598058 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-bb582816-bd9a-4d0e-be84-56eea7722566 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1549 microversion: 2.1 time: 0.360253 Aug 05 07:21:09.599260 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 369/722] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:09 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1549 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:09.622562 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-65830210-5930-4d85-9170-af55e192ebcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:09.623220 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-65830210-5930-4d85-9170-af55e192ebcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:09.631082 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-65830210-5930-4d85-9170-af55e192ebcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:09.631783 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-65830210-5930-4d85-9170-af55e192ebcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:09.632331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-65830210-5930-4d85-9170-af55e192ebcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:09.633332 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-65830210-5930-4d85-9170-af55e192ebcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:09.633981 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-65830210-5930-4d85-9170-af55e192ebcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:09.634614 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-65830210-5930-4d85-9170-af55e192ebcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:09.773286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-65830210-5930-4d85-9170-af55e192ebcc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154720 Aug 05 07:21:09.774307 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 354/723] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 5 07:21:09 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:21:10.185422 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-99827b14-d81c-4ecd-9486-f61579e0fa84 req-80bf2f36-c0bb-4733-8c7f-5cfd227a3265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d197c94-dfa3-4fe2-974d-4134fb0cb595", "tag": "155ed77d-f493-45be-ad25-67f9052f1659"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:10.205772 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-99827b14-d81c-4ecd-9486-f61579e0fa84 req-80bf2f36-c0bb-4733-8c7f-5cfd227a3265 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:10.206752 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-99827b14-d81c-4ecd-9486-f61579e0fa84 req-80bf2f36-c0bb-4733-8c7f-5cfd227a3265 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:10.207873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-99827b14-d81c-4ecd-9486-f61579e0fa84 req-80bf2f36-c0bb-4733-8c7f-5cfd227a3265 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:10.230858 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-99827b14-d81c-4ecd-9486-f61579e0fa84 req-80bf2f36-c0bb-4733-8c7f-5cfd227a3265 service nova] Creating event network-changed:155ed77d-f493-45be-ad25-67f9052f1659 for instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 on hv-cinder-85200 Aug 05 07:21:10.246910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4feb944d-6dcf-446c-bb17-77bc13690b4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:10.249194 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4feb944d-6dcf-446c-bb17-77bc13690b4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:10.254691 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-99827b14-d81c-4ecd-9486-f61579e0fa84 req-80bf2f36-c0bb-4733-8c7f-5cfd227a3265 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078251 Aug 05 07:21:10.259545 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 370/724] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:10.278587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4feb944d-6dcf-446c-bb17-77bc13690b4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:10.280045 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4feb944d-6dcf-446c-bb17-77bc13690b4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:10.281289 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4feb944d-6dcf-446c-bb17-77bc13690b4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:10.282760 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4feb944d-6dcf-446c-bb17-77bc13690b4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:10.283981 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4feb944d-6dcf-446c-bb17-77bc13690b4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:10.288441 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4feb944d-6dcf-446c-bb17-77bc13690b4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:10.767025 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4feb944d-6dcf-446c-bb17-77bc13690b4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:10.787492 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4feb944d-6dcf-446c-bb17-77bc13690b4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1265 microversion: 2.1 time: 0.545133 Aug 05 07:21:10.792828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 355/725] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:10 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1265 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:11.708176 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-577955d7-a6b8-49fc-bc27-7ec0fb9ad2ae req-7ca94f8f-e5e4-4e48-b08b-4c77de9cda03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd3c1c0-4733-45dc-ab55-794aa3ea12e9", "tag": "2fef8161-aaaa-4f88-9f08-285fe2c78aa5"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:11.739592 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-577955d7-a6b8-49fc-bc27-7ec0fb9ad2ae req-7ca94f8f-e5e4-4e48-b08b-4c77de9cda03 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:11.740512 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-577955d7-a6b8-49fc-bc27-7ec0fb9ad2ae req-7ca94f8f-e5e4-4e48-b08b-4c77de9cda03 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:11.741304 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-577955d7-a6b8-49fc-bc27-7ec0fb9ad2ae req-7ca94f8f-e5e4-4e48-b08b-4c77de9cda03 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:11.768289 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-577955d7-a6b8-49fc-bc27-7ec0fb9ad2ae req-7ca94f8f-e5e4-4e48-b08b-4c77de9cda03 service nova] Creating event network-changed:2fef8161-aaaa-4f88-9f08-285fe2c78aa5 for instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 on hv-cinder-85200 Aug 05 07:21:11.779404 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-577955d7-a6b8-49fc-bc27-7ec0fb9ad2ae req-7ca94f8f-e5e4-4e48-b08b-4c77de9cda03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083956 Aug 05 07:21:11.781671 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 371/726] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:11.823867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4be7a3a6-c715-4cf5-b908-6cddefeb4632 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:11.824658 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4be7a3a6-c715-4cf5-b908-6cddefeb4632 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:11.838615 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4be7a3a6-c715-4cf5-b908-6cddefeb4632 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:11.839297 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4be7a3a6-c715-4cf5-b908-6cddefeb4632 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:11.839584 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4be7a3a6-c715-4cf5-b908-6cddefeb4632 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:11.840329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4be7a3a6-c715-4cf5-b908-6cddefeb4632 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:11.840784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4be7a3a6-c715-4cf5-b908-6cddefeb4632 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:11.841270 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4be7a3a6-c715-4cf5-b908-6cddefeb4632 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:12.360089 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4be7a3a6-c715-4cf5-b908-6cddefeb4632 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:12.375120 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4be7a3a6-c715-4cf5-b908-6cddefeb4632 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1452 microversion: 2.1 time: 0.555382 Aug 05 07:21:12.390296 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 356/727] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:11 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1452 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:12.418858 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-04a22160-f4bc-4515-bd5d-18334da1b48b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:12.420652 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-04a22160-f4bc-4515-bd5d-18334da1b48b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:12.432420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-04a22160-f4bc-4515-bd5d-18334da1b48b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:12.437178 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-04a22160-f4bc-4515-bd5d-18334da1b48b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:12.438033 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-04a22160-f4bc-4515-bd5d-18334da1b48b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:12.439779 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-04a22160-f4bc-4515-bd5d-18334da1b48b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:12.441037 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-04a22160-f4bc-4515-bd5d-18334da1b48b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:12.441709 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-04a22160-f4bc-4515-bd5d-18334da1b48b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:12.728279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-04a22160-f4bc-4515-bd5d-18334da1b48b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:12.736784 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-04a22160-f4bc-4515-bd5d-18334da1b48b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1452 microversion: 2.1 time: 0.328708 Aug 05 07:21:12.737506 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 372/728] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:12 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1452 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:15.849577 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-a27916d3-76e1-4fc6-9d83-bc7c190c9a31 req-6f28c6f1-5a9d-4591-88e8-eb03e1a00d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2739a6-db43-428a-9342-53229c6530fb", "tag": "f7adc9e7-faaa-401c-97e8-c38dbcabbbf9"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:15.859989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:15.866260 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-a27916d3-76e1-4fc6-9d83-bc7c190c9a31 req-6f28c6f1-5a9d-4591-88e8-eb03e1a00d2f service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:15.867200 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-a27916d3-76e1-4fc6-9d83-bc7c190c9a31 req-6f28c6f1-5a9d-4591-88e8-eb03e1a00d2f service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:15.867841 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-a27916d3-76e1-4fc6-9d83-bc7c190c9a31 req-6f28c6f1-5a9d-4591-88e8-eb03e1a00d2f service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:15.886044 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-a27916d3-76e1-4fc6-9d83-bc7c190c9a31 req-6f28c6f1-5a9d-4591-88e8-eb03e1a00d2f service nova] Creating event network-changed:f7adc9e7-faaa-401c-97e8-c38dbcabbbf9 for instance 5b2739a6-db43-428a-9342-53229c6530fb on hv-cinder-85200 Aug 05 07:21:15.895913 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-a27916d3-76e1-4fc6-9d83-bc7c190c9a31 req-6f28c6f1-5a9d-4591-88e8-eb03e1a00d2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050779 Aug 05 07:21:15.901702 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 357/729] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:21:17.249670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-198858555", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "networks": [{"uuid": "5ed1b929-aae5-4ee5-8880-77abb612e4c3"}]}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:17.324986 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] validate_networks() for [('5ed1b929-aae5-4ee5-8880-77abb612e4c3', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:21:17.811679 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:21:17.812141 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:21:17.812690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:21:17.813190 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:21:17.813662 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:21:17.824644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:17.825170 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:17.825603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:17.826339 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:17.826832 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:17.827252 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:17.846178 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Getting quotas for project af97b401094c4317b62595ea76cdd6ec. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:21:17.850991 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Getting quotas for user e61cfea5a8c44105bbb2906fff46df7b and project af97b401094c4317b62595ea76cdd6ec. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:21:17.865782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:21:17.868273 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:21:17.919689 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-6f7258a8-5abd-4da7-b800-173134baf283 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673980 Aug 05 07:21:17.920482 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 373/730] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:21:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 07:21:17.933239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ac4aa2e2-0930-4308-80ab-748d87b8fb58 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:17.934361 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ac4aa2e2-0930-4308-80ab-748d87b8fb58 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:18.011555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ac4aa2e2-0930-4308-80ab-748d87b8fb58 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:18.021630 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ac4aa2e2-0930-4308-80ab-748d87b8fb58 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1213 microversion: 2.1 time: 0.093665 Aug 05 07:21:18.022230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 358/731] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:17 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:19.054353 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-586fb983-b533-4348-8521-d9a37e258ea4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:19.055000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-586fb983-b533-4348-8521-d9a37e258ea4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:19.063631 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-586fb983-b533-4348-8521-d9a37e258ea4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:19.064116 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-586fb983-b533-4348-8521-d9a37e258ea4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:19.064538 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-586fb983-b533-4348-8521-d9a37e258ea4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:19.065328 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-586fb983-b533-4348-8521-d9a37e258ea4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:19.065778 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-586fb983-b533-4348-8521-d9a37e258ea4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:19.066192 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-586fb983-b533-4348-8521-d9a37e258ea4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:19.142782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-586fb983-b533-4348-8521-d9a37e258ea4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:19.151335 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-586fb983-b533-4348-8521-d9a37e258ea4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1265 microversion: 2.1 time: 0.101485 Aug 05 07:21:19.151949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 374/732] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:19 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:20.177756 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-05b869e8-e7b1-4cf3-91a0-1ee82f581317 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:20.178869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-05b869e8-e7b1-4cf3-91a0-1ee82f581317 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:20.190825 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-05b869e8-e7b1-4cf3-91a0-1ee82f581317 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:20.191729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-05b869e8-e7b1-4cf3-91a0-1ee82f581317 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:20.192458 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-05b869e8-e7b1-4cf3-91a0-1ee82f581317 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:20.193693 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-05b869e8-e7b1-4cf3-91a0-1ee82f581317 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:20.194504 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-05b869e8-e7b1-4cf3-91a0-1ee82f581317 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:20.195245 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-05b869e8-e7b1-4cf3-91a0-1ee82f581317 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:20.500271 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-05b869e8-e7b1-4cf3-91a0-1ee82f581317 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:20.510800 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-05b869e8-e7b1-4cf3-91a0-1ee82f581317 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1313 microversion: 2.1 time: 0.340126 Aug 05 07:21:20.511607 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 359/733] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:20 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:20.876002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-aedebf86-ca78-4997-890e-5a93151d224e req-49e70a37-7505-496e-a68b-85abdb2d3864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3bfc048-68e5-430d-9448-23bd2fb2552f", "tag": "dd256fbf-1871-475c-a09c-53676775d39d"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:20.893505 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-aedebf86-ca78-4997-890e-5a93151d224e req-49e70a37-7505-496e-a68b-85abdb2d3864 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:20.894382 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-aedebf86-ca78-4997-890e-5a93151d224e req-49e70a37-7505-496e-a68b-85abdb2d3864 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:20.895755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-aedebf86-ca78-4997-890e-5a93151d224e req-49e70a37-7505-496e-a68b-85abdb2d3864 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:20.917395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-aedebf86-ca78-4997-890e-5a93151d224e req-49e70a37-7505-496e-a68b-85abdb2d3864 service nova] Creating event network-changed:dd256fbf-1871-475c-a09c-53676775d39d for instance b3bfc048-68e5-430d-9448-23bd2fb2552f on hv-cinder-85200 Aug 05 07:21:20.927400 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-aedebf86-ca78-4997-890e-5a93151d224e req-49e70a37-7505-496e-a68b-85abdb2d3864 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054701 Aug 05 07:21:20.928642 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 375/734] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:21.538138 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e16f1d8f-521e-4ee3-82b4-c447383d1ea5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:21.539043 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e16f1d8f-521e-4ee3-82b4-c447383d1ea5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:21.546126 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e16f1d8f-521e-4ee3-82b4-c447383d1ea5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:21.546609 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e16f1d8f-521e-4ee3-82b4-c447383d1ea5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:21.547030 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e16f1d8f-521e-4ee3-82b4-c447383d1ea5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:21.547740 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e16f1d8f-521e-4ee3-82b4-c447383d1ea5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:21.548187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e16f1d8f-521e-4ee3-82b4-c447383d1ea5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:21.548598 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e16f1d8f-521e-4ee3-82b4-c447383d1ea5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:21.735030 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e16f1d8f-521e-4ee3-82b4-c447383d1ea5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:21.744198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e16f1d8f-521e-4ee3-82b4-c447383d1ea5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1313 microversion: 2.1 time: 0.210011 Aug 05 07:21:21.745039 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 360/735] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:21 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:22.767080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1abaebef-0fe9-4ccc-b20f-8b83d0756260 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:22.767780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1abaebef-0fe9-4ccc-b20f-8b83d0756260 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:22.774882 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1abaebef-0fe9-4ccc-b20f-8b83d0756260 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:22.775380 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1abaebef-0fe9-4ccc-b20f-8b83d0756260 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:22.775811 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1abaebef-0fe9-4ccc-b20f-8b83d0756260 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:22.776530 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1abaebef-0fe9-4ccc-b20f-8b83d0756260 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:22.777100 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1abaebef-0fe9-4ccc-b20f-8b83d0756260 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:22.777521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1abaebef-0fe9-4ccc-b20f-8b83d0756260 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:22.973230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1abaebef-0fe9-4ccc-b20f-8b83d0756260 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:22.987542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1abaebef-0fe9-4ccc-b20f-8b83d0756260 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1313 microversion: 2.1 time: 0.225528 Aug 05 07:21:22.988607 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 376/736] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:22 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:24.023269 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3ce6a312-16b0-4ccd-ab41-50c746ebf7fb tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:24.024046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3ce6a312-16b0-4ccd-ab41-50c746ebf7fb tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:24.031973 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ce6a312-16b0-4ccd-ab41-50c746ebf7fb tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:24.032468 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ce6a312-16b0-4ccd-ab41-50c746ebf7fb tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:24.032932 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ce6a312-16b0-4ccd-ab41-50c746ebf7fb tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:24.033663 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ce6a312-16b0-4ccd-ab41-50c746ebf7fb tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:24.034112 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ce6a312-16b0-4ccd-ab41-50c746ebf7fb tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:24.034531 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ce6a312-16b0-4ccd-ab41-50c746ebf7fb tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:24.598710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3ce6a312-16b0-4ccd-ab41-50c746ebf7fb tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:24.607756 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3ce6a312-16b0-4ccd-ab41-50c746ebf7fb tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1313 microversion: 2.1 time: 0.590298 Aug 05 07:21:24.608540 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 361/737] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:24 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:25.640839 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5e0a79c1-5102-4211-af32-be7a14280583 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:25.641552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5e0a79c1-5102-4211-af32-be7a14280583 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:25.648768 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5e0a79c1-5102-4211-af32-be7a14280583 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:25.649293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5e0a79c1-5102-4211-af32-be7a14280583 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:25.649703 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5e0a79c1-5102-4211-af32-be7a14280583 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:25.650425 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5e0a79c1-5102-4211-af32-be7a14280583 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:25.650875 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5e0a79c1-5102-4211-af32-be7a14280583 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:25.651298 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5e0a79c1-5102-4211-af32-be7a14280583 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:25.802228 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5e0a79c1-5102-4211-af32-be7a14280583 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:25.810692 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5e0a79c1-5102-4211-af32-be7a14280583 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1313 microversion: 2.1 time: 0.174401 Aug 05 07:21:25.811299 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 377/738] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:25 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:26.836266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bdf35555-205e-49f3-882b-c33855fae2fc tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:26.837239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bdf35555-205e-49f3-882b-c33855fae2fc tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:26.848728 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bdf35555-205e-49f3-882b-c33855fae2fc tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:26.849592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bdf35555-205e-49f3-882b-c33855fae2fc tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:26.850331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bdf35555-205e-49f3-882b-c33855fae2fc tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:26.851567 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bdf35555-205e-49f3-882b-c33855fae2fc tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:26.852346 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bdf35555-205e-49f3-882b-c33855fae2fc tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:26.853104 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bdf35555-205e-49f3-882b-c33855fae2fc tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:27.025101 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bdf35555-205e-49f3-882b-c33855fae2fc tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:27.029038 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:27.035592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bdf35555-205e-49f3-882b-c33855fae2fc tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1313 microversion: 2.1 time: 0.206678 Aug 05 07:21:27.036198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 362/739] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:26 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:28.071771 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7a5d1dd9-c583-4ecb-bd9d-d78311e8e97b tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:28.072827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7a5d1dd9-c583-4ecb-bd9d-d78311e8e97b tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:28.078058 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:28.081846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=6 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:28.092565 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7a5d1dd9-c583-4ecb-bd9d-d78311e8e97b tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:28.093386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7a5d1dd9-c583-4ecb-bd9d-d78311e8e97b tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:28.094092 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7a5d1dd9-c583-4ecb-bd9d-d78311e8e97b tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:28.095301 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7a5d1dd9-c583-4ecb-bd9d-d78311e8e97b tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:28.096117 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7a5d1dd9-c583-4ecb-bd9d-d78311e8e97b tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:28.096828 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7a5d1dd9-c583-4ecb-bd9d-d78311e8e97b tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:28.101107 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-de1d37e0-9e45-4e6d-b5d6-fd68a64a8632 req-ae3ecb1f-894a-4d72-b02d-ae9137882778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3bfc048-68e5-430d-9448-23bd2fb2552f", "name": "network-vif-plugged", "status": "completed", "tag": "dd256fbf-1871-475c-a09c-53676775d39d"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:28.117692 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:28.121642 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-de1d37e0-9e45-4e6d-b5d6-fd68a64a8632 req-ae3ecb1f-894a-4d72-b02d-ae9137882778 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:28.122578 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-de1d37e0-9e45-4e6d-b5d6-fd68a64a8632 req-ae3ecb1f-894a-4d72-b02d-ae9137882778 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:28.123264 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-de1d37e0-9e45-4e6d-b5d6-fd68a64a8632 req-ae3ecb1f-894a-4d72-b02d-ae9137882778 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:28.150344 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-de1d37e0-9e45-4e6d-b5d6-fd68a64a8632 req-ae3ecb1f-894a-4d72-b02d-ae9137882778 service nova] Creating event network-vif-plugged:dd256fbf-1871-475c-a09c-53676775d39d for instance b3bfc048-68e5-430d-9448-23bd2fb2552f on hv-cinder-85200 Aug 05 07:21:28.160734 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-de1d37e0-9e45-4e6d-b5d6-fd68a64a8632 req-ae3ecb1f-894a-4d72-b02d-ae9137882778 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068544 Aug 05 07:21:28.161575 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 363/740] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:28.341804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7a5d1dd9-c583-4ecb-bd9d-d78311e8e97b tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:28.357237 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7a5d1dd9-c583-4ecb-bd9d-d78311e8e97b tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1313 microversion: 2.1 time: 0.290216 Aug 05 07:21:28.357962 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 378/741] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:28 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:29.379893 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ac41d819-4075-4fef-8036-d0bea0e03519 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:29.380654 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ac41d819-4075-4fef-8036-d0bea0e03519 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:29.387822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac41d819-4075-4fef-8036-d0bea0e03519 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:29.388308 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac41d819-4075-4fef-8036-d0bea0e03519 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:29.388742 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac41d819-4075-4fef-8036-d0bea0e03519 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:29.389518 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac41d819-4075-4fef-8036-d0bea0e03519 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:29.390325 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac41d819-4075-4fef-8036-d0bea0e03519 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:29.390736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac41d819-4075-4fef-8036-d0bea0e03519 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:29.545703 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ac41d819-4075-4fef-8036-d0bea0e03519 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:29.554579 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ac41d819-4075-4fef-8036-d0bea0e03519 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1313 microversion: 2.1 time: 0.179434 Aug 05 07:21:29.555155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 364/742] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:29 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:30.575896 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2bad02a9-a614-466a-924c-a6988575c89f tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:30.576570 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2bad02a9-a614-466a-924c-a6988575c89f tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:30.583786 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2bad02a9-a614-466a-924c-a6988575c89f tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:30.584274 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2bad02a9-a614-466a-924c-a6988575c89f tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:30.584698 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2bad02a9-a614-466a-924c-a6988575c89f tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:30.585456 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2bad02a9-a614-466a-924c-a6988575c89f tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:30.585905 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2bad02a9-a614-466a-924c-a6988575c89f tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:30.586321 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2bad02a9-a614-466a-924c-a6988575c89f tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:30.741480 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2bad02a9-a614-466a-924c-a6988575c89f tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:30.750888 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2bad02a9-a614-466a-924c-a6988575c89f tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1313 microversion: 2.1 time: 0.179130 Aug 05 07:21:30.751505 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 379/743] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:30 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:31.772550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0d749aa3-5976-4b4a-8b70-f09ade534189 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:31.773264 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0d749aa3-5976-4b4a-8b70-f09ade534189 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:31.780623 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d749aa3-5976-4b4a-8b70-f09ade534189 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:31.781216 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d749aa3-5976-4b4a-8b70-f09ade534189 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:31.781694 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d749aa3-5976-4b4a-8b70-f09ade534189 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:31.782459 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d749aa3-5976-4b4a-8b70-f09ade534189 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:31.782955 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d749aa3-5976-4b4a-8b70-f09ade534189 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:31.783416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d749aa3-5976-4b4a-8b70-f09ade534189 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:31.951072 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0d749aa3-5976-4b4a-8b70-f09ade534189 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:31.959572 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0d749aa3-5976-4b4a-8b70-f09ade534189 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1497 microversion: 2.1 time: 0.191107 Aug 05 07:21:31.961197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 365/744] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:31 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:32.650237 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-fc45d081-021a-449c-a2ce-e98a4989876c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:32.651010 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-fc45d081-021a-449c-a2ce-e98a4989876c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:32.658578 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fc45d081-021a-449c-a2ce-e98a4989876c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:32.659067 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fc45d081-021a-449c-a2ce-e98a4989876c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:32.659491 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fc45d081-021a-449c-a2ce-e98a4989876c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:32.660225 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fc45d081-021a-449c-a2ce-e98a4989876c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:32.660679 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fc45d081-021a-449c-a2ce-e98a4989876c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:32.661151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fc45d081-021a-449c-a2ce-e98a4989876c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:32.689015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-fc45d081-021a-449c-a2ce-e98a4989876c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Going to try to terminate instance {{(pid=117894) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:21:32.777424 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-fc45d081-021a-449c-a2ce-e98a4989876c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 204 len: 0 microversion: 2.1 time: 0.132826 Aug 05 07:21:32.778041 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 380/745] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:21:32 2022] DELETE /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:21:32.787662 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b4737ae0-545e-44fb-bc8b-daa8d8078bef tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:32.788584 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b4737ae0-545e-44fb-bc8b-daa8d8078bef tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:32.797127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4737ae0-545e-44fb-bc8b-daa8d8078bef tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:32.797623 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4737ae0-545e-44fb-bc8b-daa8d8078bef tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:32.798040 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4737ae0-545e-44fb-bc8b-daa8d8078bef tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:32.798756 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4737ae0-545e-44fb-bc8b-daa8d8078bef tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:32.799210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4737ae0-545e-44fb-bc8b-daa8d8078bef tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:32.799635 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4737ae0-545e-44fb-bc8b-daa8d8078bef tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:32.960728 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b4737ae0-545e-44fb-bc8b-daa8d8078bef tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:32.969103 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b4737ae0-545e-44fb-bc8b-daa8d8078bef tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1503 microversion: 2.1 time: 0.185989 Aug 05 07:21:32.969745 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 366/746] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:32 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:21:32.977098 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-43cda336-08cb-49db-8f54-4f1795894431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:32.977912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-43cda336-08cb-49db-8f54-4f1795894431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:32.985032 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-43cda336-08cb-49db-8f54-4f1795894431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:32.985508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-43cda336-08cb-49db-8f54-4f1795894431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:32.985952 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-43cda336-08cb-49db-8f54-4f1795894431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:32.986658 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-43cda336-08cb-49db-8f54-4f1795894431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:32.987102 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-43cda336-08cb-49db-8f54-4f1795894431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:32.987529 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-43cda336-08cb-49db-8f54-4f1795894431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:33.016978 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-43cda336-08cb-49db-8f54-4f1795894431 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/ips" status: 200 len: 148 microversion: 2.1 time: 0.044290 Aug 05 07:21:33.018193 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 381/747] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 5 07:21:32 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/ips => generated 148 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:21:34.004204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3500fe5d-5b97-4b1f-a81b-c74a7ee6c7df tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:34.005053 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3500fe5d-5b97-4b1f-a81b-c74a7ee6c7df tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:34.013047 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3500fe5d-5b97-4b1f-a81b-c74a7ee6c7df tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:34.013831 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3500fe5d-5b97-4b1f-a81b-c74a7ee6c7df tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:34.014606 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3500fe5d-5b97-4b1f-a81b-c74a7ee6c7df tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:34.016071 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3500fe5d-5b97-4b1f-a81b-c74a7ee6c7df tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:34.016754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3500fe5d-5b97-4b1f-a81b-c74a7ee6c7df tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:34.017562 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3500fe5d-5b97-4b1f-a81b-c74a7ee6c7df tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:34.167645 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3500fe5d-5b97-4b1f-a81b-c74a7ee6c7df tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:34.176657 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3500fe5d-5b97-4b1f-a81b-c74a7ee6c7df tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1503 microversion: 2.1 time: 0.176582 Aug 05 07:21:34.177307 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 367/748] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:33 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:34.460117 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-39417e7f-a61f-48de-b899-affd9a3be635 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62970522-9891-4c1a-8462-ffeb2beea96d"}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:34.462773 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-39417e7f-a61f-48de-b899-affd9a3be635 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:34.465565 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:34.471272 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-39417e7f-a61f-48de-b899-affd9a3be635 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:34.471759 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-39417e7f-a61f-48de-b899-affd9a3be635 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:34.472193 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-39417e7f-a61f-48de-b899-affd9a3be635 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:34.473041 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-39417e7f-a61f-48de-b899-affd9a3be635 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:34.473569 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-39417e7f-a61f-48de-b899-affd9a3be635 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:34.473992 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-39417e7f-a61f-48de-b899-affd9a3be635 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:35.202741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-35bec8ba-4527-42be-85eb-79783db51a69 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:35.204097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-35bec8ba-4527-42be-85eb-79783db51a69 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:35.210097 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-39417e7f-a61f-48de-b899-affd9a3be635 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.753907 Aug 05 07:21:35.211339 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 382/749] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:21:34 2022] POST /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:35.217927 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35bec8ba-4527-42be-85eb-79783db51a69 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:35.234001 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35bec8ba-4527-42be-85eb-79783db51a69 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:35.235210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35bec8ba-4527-42be-85eb-79783db51a69 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:35.239180 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35bec8ba-4527-42be-85eb-79783db51a69 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:35.240039 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35bec8ba-4527-42be-85eb-79783db51a69 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:35.240820 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35bec8ba-4527-42be-85eb-79783db51a69 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:35.580280 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-35bec8ba-4527-42be-85eb-79783db51a69 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:35.593217 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-35bec8ba-4527-42be-85eb-79783db51a69 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 200 len: 1503 microversion: 2.1 time: 0.397112 Aug 05 07:21:35.594317 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 368/750] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:35 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 1503 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:35.715181 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-19f4bb64-34e5-4bff-903a-e990443fb8e4 req-d1398ae3-54fa-45f5-8ff7-9280405f5797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3bfc048-68e5-430d-9448-23bd2fb2552f", "name": "network-vif-deleted", "tag": "dd256fbf-1871-475c-a09c-53676775d39d"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:35.727068 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-19f4bb64-34e5-4bff-903a-e990443fb8e4 req-d1398ae3-54fa-45f5-8ff7-9280405f5797 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:35.727607 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-19f4bb64-34e5-4bff-903a-e990443fb8e4 req-d1398ae3-54fa-45f5-8ff7-9280405f5797 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:35.728054 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-19f4bb64-34e5-4bff-903a-e990443fb8e4 req-d1398ae3-54fa-45f5-8ff7-9280405f5797 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:35.741505 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-19f4bb64-34e5-4bff-903a-e990443fb8e4 req-d1398ae3-54fa-45f5-8ff7-9280405f5797 service nova] Creating event network-vif-deleted:dd256fbf-1871-475c-a09c-53676775d39d for instance b3bfc048-68e5-430d-9448-23bd2fb2552f on hv-cinder-85200 Aug 05 07:21:35.747078 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-19f4bb64-34e5-4bff-903a-e990443fb8e4 req-d1398ae3-54fa-45f5-8ff7-9280405f5797 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036577 Aug 05 07:21:35.748238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 383/751] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:36.627467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dd10a0d5-b8c9-4aa1-bca7-229a9001b45e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:36.628181 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dd10a0d5-b8c9-4aa1-bca7-229a9001b45e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: b3bfc048-68e5-430d-9448-23bd2fb2552f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:36.635917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd10a0d5-b8c9-4aa1-bca7-229a9001b45e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:36.636402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd10a0d5-b8c9-4aa1-bca7-229a9001b45e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:36.636825 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd10a0d5-b8c9-4aa1-bca7-229a9001b45e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:36.637567 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd10a0d5-b8c9-4aa1-bca7-229a9001b45e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:36.638018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd10a0d5-b8c9-4aa1-bca7-229a9001b45e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:36.638473 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd10a0d5-b8c9-4aa1-bca7-229a9001b45e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:36.654738 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-dd10a0d5-b8c9-4aa1-bca7-229a9001b45e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] HTTP exception thrown: Instance b3bfc048-68e5-430d-9448-23bd2fb2552f could not be found. Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dd10a0d5-b8c9-4aa1-bca7-229a9001b45e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Request method failure captured: Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f HTTP/1.1 Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MTrQSgUupcEJTZw3p76SMuq_rxsDepv5QdlTk-d8rTUHfDIeC7LMejQ7OYvelA6tT22MvKolja4FOFYPVM3q0CAuNZeiGADZ05oNr3xmWK9RxGfqr4_921E_pyCS96olJe5P8galJ4k6amOacHoiuRQNpv_9Df6hN-fNuPfD8QrRqQ Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: af97b401094c4317b62595ea76cdd6ec Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesActionsTest-1693050960 Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:21:36.656416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:21:36.658924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_af97b401094c4317b62595ea76cdd6ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af97b401094c4317b62595ea76cdd6ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af97b401094c4317b62595ea76cdd6ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/af97b401094c4317b62595ea76cdd6ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:21:36.658924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesActionsTest-1693050960 Aug 05 07:21:36.658924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: af97b401094c4317b62595ea76cdd6ec Aug 05 07:21:36.658924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesActionsTest-1693050960 Aug 05 07:21:36.658924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesActionsTest-1693050960-project Aug 05 07:21:36.658924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:21:36.658924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:21:36.658924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: e61cfea5a8c44105bbb2906fff46df7b Aug 05 07:21:36.658924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesActionsTest-1693050960-project Aug 05 07:21:36.658924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:21:36.658924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance b3bfc048-68e5-430d-9448-23bd2fb2552f could not be found. Aug 05 07:21:36.658924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'b3bfc048-68e5-430d-9448-23bd2fb2552f'} Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3bfc048-68e5-430d-9448-23bd2fb2552f could not be found. Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:21:36.660502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3bfc048-68e5-430d-9448-23bd2fb2552f could not be found. Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3bfc048-68e5-430d-9448-23bd2fb2552f could not be found. Aug 05 07:21:36.663048 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:21:36.665454 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dd10a0d5-b8c9-4aa1-bca7-229a9001b45e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Returning 404 to user: Instance b3bfc048-68e5-430d-9448-23bd2fb2552f could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:21:36.665454 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-dd10a0d5-b8c9-4aa1-bca7-229a9001b45e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f" status: 404 len: 111 microversion: 2.1 time: 0.034641 Aug 05 07:21:36.665454 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 369/752] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:36 2022] GET /compute/v2.1/servers/b3bfc048-68e5-430d-9448-23bd2fb2552f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:21:36.715087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1097848040", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "networks": [{"uuid": "5ed1b929-aae5-4ee5-8880-77abb612e4c3"}]}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:36.774555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] validate_networks() for [('5ed1b929-aae5-4ee5-8880-77abb612e4c3', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:21:37.166332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:21:37.166810 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:21:37.167370 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:21:37.167809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:21:37.168405 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:21:37.179735 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:37.180293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:37.180719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:37.181465 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:37.181916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:37.182326 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:37.202376 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Getting quotas for project af97b401094c4317b62595ea76cdd6ec. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:21:37.208743 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Getting quotas for user e61cfea5a8c44105bbb2906fff46df7b and project af97b401094c4317b62595ea76cdd6ec. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:21:37.223086 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:21:37.225598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:21:37.279692 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-bf276040-dc67-4e24-9d74-e98e6b093f05 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569554 Aug 05 07:21:37.280561 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 384/753] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:21:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:21:37.291915 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8a0db4c7-e7dd-4eac-9f75-419d24d52de1 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:37.292617 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8a0db4c7-e7dd-4eac-9f75-419d24d52de1 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:37.354252 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8a0db4c7-e7dd-4eac-9f75-419d24d52de1 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:37.363099 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8a0db4c7-e7dd-4eac-9f75-419d24d52de1 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1214 microversion: 2.1 time: 0.075217 Aug 05 07:21:37.363826 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 370/754] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:37 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:38.392400 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-aba7922e-870b-43de-b5a5-ebddb3f0cf1d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:38.393535 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-aba7922e-870b-43de-b5a5-ebddb3f0cf1d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:38.407924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-aba7922e-870b-43de-b5a5-ebddb3f0cf1d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:38.410159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-aba7922e-870b-43de-b5a5-ebddb3f0cf1d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:38.411785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-aba7922e-870b-43de-b5a5-ebddb3f0cf1d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:38.413437 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-aba7922e-870b-43de-b5a5-ebddb3f0cf1d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:38.414568 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-aba7922e-870b-43de-b5a5-ebddb3f0cf1d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:38.415275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-aba7922e-870b-43de-b5a5-ebddb3f0cf1d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:38.452291 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:38.559212 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-aba7922e-870b-43de-b5a5-ebddb3f0cf1d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:38.587708 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-aba7922e-870b-43de-b5a5-ebddb3f0cf1d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1274 microversion: 2.1 time: 0.204294 Aug 05 07:21:38.589572 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 385/755] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:38 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1274 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:39.623778 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-40121c4d-9489-495f-a0e6-f2327ccb4acd tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:39.625918 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-40121c4d-9489-495f-a0e6-f2327ccb4acd tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:39.647180 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40121c4d-9489-495f-a0e6-f2327ccb4acd tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:39.647911 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40121c4d-9489-495f-a0e6-f2327ccb4acd tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:39.648510 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40121c4d-9489-495f-a0e6-f2327ccb4acd tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:39.649629 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40121c4d-9489-495f-a0e6-f2327ccb4acd tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:39.650615 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40121c4d-9489-495f-a0e6-f2327ccb4acd tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:39.651018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-40121c4d-9489-495f-a0e6-f2327ccb4acd tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:39.903380 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-40121c4d-9489-495f-a0e6-f2327ccb4acd tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:39.917261 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-40121c4d-9489-495f-a0e6-f2327ccb4acd tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1314 microversion: 2.1 time: 0.301267 Aug 05 07:21:39.918333 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 371/756] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:39 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:40.302562 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-0a12b28b-7280-45da-834f-47a5d99f2793 req-5d7f08d6-0925-445b-aab4-4a013452cf6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "812fb9dd-0f63-44fc-abe6-cb4e71c20f37", "tag": "bd021c02-544b-45ec-8b6a-6d0e15745c25"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:40.316278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-0a12b28b-7280-45da-834f-47a5d99f2793 req-5d7f08d6-0925-445b-aab4-4a013452cf6c service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:40.316941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-0a12b28b-7280-45da-834f-47a5d99f2793 req-5d7f08d6-0925-445b-aab4-4a013452cf6c service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:40.317430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-0a12b28b-7280-45da-834f-47a5d99f2793 req-5d7f08d6-0925-445b-aab4-4a013452cf6c service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:40.330352 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-0a12b28b-7280-45da-834f-47a5d99f2793 req-5d7f08d6-0925-445b-aab4-4a013452cf6c service nova] Creating event network-changed:bd021c02-544b-45ec-8b6a-6d0e15745c25 for instance 812fb9dd-0f63-44fc-abe6-cb4e71c20f37 on hv-cinder-85200 Aug 05 07:21:40.335754 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-0a12b28b-7280-45da-834f-47a5d99f2793 req-5d7f08d6-0925-445b-aab4-4a013452cf6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041262 Aug 05 07:21:40.337167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 386/757] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:21:40.950891 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-371d389a-b7dc-4801-bbcf-8c5c1c40dde5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:40.951572 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-371d389a-b7dc-4801-bbcf-8c5c1c40dde5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:40.958828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-371d389a-b7dc-4801-bbcf-8c5c1c40dde5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:40.959345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-371d389a-b7dc-4801-bbcf-8c5c1c40dde5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:40.959751 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-371d389a-b7dc-4801-bbcf-8c5c1c40dde5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:40.960470 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-371d389a-b7dc-4801-bbcf-8c5c1c40dde5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:40.960945 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-371d389a-b7dc-4801-bbcf-8c5c1c40dde5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:40.961366 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-371d389a-b7dc-4801-bbcf-8c5c1c40dde5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:41.121818 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-371d389a-b7dc-4801-bbcf-8c5c1c40dde5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:41.130819 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-371d389a-b7dc-4801-bbcf-8c5c1c40dde5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1314 microversion: 2.1 time: 0.184360 Aug 05 07:21:41.131412 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 372/758] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:40 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:42.154638 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-93807855-fe6b-4881-996f-9f54d204c433 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:42.155248 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-93807855-fe6b-4881-996f-9f54d204c433 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:42.162809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-93807855-fe6b-4881-996f-9f54d204c433 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:42.163341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-93807855-fe6b-4881-996f-9f54d204c433 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:42.163804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-93807855-fe6b-4881-996f-9f54d204c433 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:42.164552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-93807855-fe6b-4881-996f-9f54d204c433 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:42.165116 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-93807855-fe6b-4881-996f-9f54d204c433 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:42.165572 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-93807855-fe6b-4881-996f-9f54d204c433 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:42.321139 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-93807855-fe6b-4881-996f-9f54d204c433 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:42.330102 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-93807855-fe6b-4881-996f-9f54d204c433 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1314 microversion: 2.1 time: 0.180454 Aug 05 07:21:42.330714 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 387/759] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:42 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:43.351192 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-77be5dd4-310d-481c-ac70-4832f2560c00 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:43.352039 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-77be5dd4-310d-481c-ac70-4832f2560c00 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:43.358857 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77be5dd4-310d-481c-ac70-4832f2560c00 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:43.359502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77be5dd4-310d-481c-ac70-4832f2560c00 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:43.359753 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77be5dd4-310d-481c-ac70-4832f2560c00 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:43.360446 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77be5dd4-310d-481c-ac70-4832f2560c00 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:43.363379 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77be5dd4-310d-481c-ac70-4832f2560c00 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:43.363379 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77be5dd4-310d-481c-ac70-4832f2560c00 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:43.592012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-77be5dd4-310d-481c-ac70-4832f2560c00 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:43.600412 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-77be5dd4-310d-481c-ac70-4832f2560c00 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1314 microversion: 2.1 time: 0.253199 Aug 05 07:21:43.601065 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 373/760] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:43 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:44.624444 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b1a73a64-7633-4ba8-b559-5d2a45fff520 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:44.626117 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b1a73a64-7633-4ba8-b559-5d2a45fff520 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:44.634650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1a73a64-7633-4ba8-b559-5d2a45fff520 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:44.635398 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1a73a64-7633-4ba8-b559-5d2a45fff520 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:44.635611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1a73a64-7633-4ba8-b559-5d2a45fff520 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:44.636616 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1a73a64-7633-4ba8-b559-5d2a45fff520 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:44.636980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1a73a64-7633-4ba8-b559-5d2a45fff520 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:44.637506 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1a73a64-7633-4ba8-b559-5d2a45fff520 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:44.806209 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b1a73a64-7633-4ba8-b559-5d2a45fff520 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:44.815435 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b1a73a64-7633-4ba8-b559-5d2a45fff520 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1314 microversion: 2.1 time: 0.195233 Aug 05 07:21:44.816151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 388/761] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:44 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:45.167857 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0781fb1d-e588-4c6b-9a82-efd47d0d43f2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62970522-9891-4c1a-8462-ffeb2beea96d"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:45.170425 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0781fb1d-e588-4c6b-9a82-efd47d0d43f2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:45.177709 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0781fb1d-e588-4c6b-9a82-efd47d0d43f2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:45.178347 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0781fb1d-e588-4c6b-9a82-efd47d0d43f2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:45.178790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0781fb1d-e588-4c6b-9a82-efd47d0d43f2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:45.179515 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0781fb1d-e588-4c6b-9a82-efd47d0d43f2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:45.179973 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0781fb1d-e588-4c6b-9a82-efd47d0d43f2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:45.180409 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0781fb1d-e588-4c6b-9a82-efd47d0d43f2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:45.272317 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-0781fb1d-e588-4c6b-9a82-efd47d0d43f2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Invalid volume: volume 62970522-9891-4c1a-8462-ffeb2beea96d is already attached to instances: 001d9229-32a3-4aa2-9e7d-c4d306c30d49 Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0781fb1d-e588-4c6b-9a82-efd47d0d43f2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: POST /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments HTTP/1.1 Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 74 Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:21:45.273987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:21:45.276436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:21:45.276436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:21:45.276436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:21:45.276436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:21:45.276436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:21:45.276436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:21:45.276436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:21:45.276436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:21:45.276436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:21:45.276436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Aug 05 07:21:45.276436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {"volumeAttachment": {"volumeId": "62970522-9891-4c1a-8462-ffeb2beea96d"}} Aug 05 07:21:45.276436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Invalid volume: volume 62970522-9891-4c1a-8462-ffeb2beea96d is already attached to instances: 001d9229-32a3-4aa2-9e7d-c4d306c30d49 Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'server_id': '001d9229-32a3-4aa2-9e7d-c4d306c30d49', 'body': {'volumeAttachment': {'volumeId': '62970522-9891-4c1a-8462-ffeb2beea96d'}}} Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 62970522-9891-4c1a-8462-ffeb2beea96d is already attached to instances: 001d9229-32a3-4aa2-9e7d-c4d306c30d49 Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:21:45.277773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 62970522-9891-4c1a-8462-ffeb2beea96d is already attached to instances: 001d9229-32a3-4aa2-9e7d-c4d306c30d49 Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:21:45.280012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:21:45.282339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:21:45.282339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:21:45.282339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:21:45.282339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 62970522-9891-4c1a-8462-ffeb2beea96d is already attached to instances: 001d9229-32a3-4aa2-9e7d-c4d306c30d49 Aug 05 07:21:45.282339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:21:45.282339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0781fb1d-e588-4c6b-9a82-efd47d0d43f2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 400 to user: Invalid volume: volume 62970522-9891-4c1a-8462-ffeb2beea96d is already attached to instances: 001d9229-32a3-4aa2-9e7d-c4d306c30d49 {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:21:45.282339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0781fb1d-e588-4c6b-9a82-efd47d0d43f2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112326 Aug 05 07:21:45.282339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 374/762] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:21:45 2022] POST /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 07:21:45.351834 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e08f3996-361b-412b-84ef-9fef4fceb093 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:45.352324 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e08f3996-361b-412b-84ef-9fef4fceb093 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:45.358862 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e08f3996-361b-412b-84ef-9fef4fceb093 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:45.359349 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e08f3996-361b-412b-84ef-9fef4fceb093 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:45.359770 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e08f3996-361b-412b-84ef-9fef4fceb093 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:45.360466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e08f3996-361b-412b-84ef-9fef4fceb093 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:45.360928 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e08f3996-361b-412b-84ef-9fef4fceb093 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:45.361364 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e08f3996-361b-412b-84ef-9fef4fceb093 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:45.458036 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-e08f3996-361b-412b-84ef-9fef4fceb093 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lazy-loading 'services' on Instance uuid 001d9229-32a3-4aa2-9e7d-c4d306c30d49 {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:21:45.539020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e08f3996-361b-412b-84ef-9fef4fceb093 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments/62970522-9891-4c1a-8462-ffeb2beea96d" status: 202 len: 0 microversion: 2.1 time: 0.191119 Aug 05 07:21:45.539926 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 389/763] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 5 07:21:45 2022] DELETE /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments/62970522-9891-4c1a-8462-ffeb2beea96d => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:21:45.552456 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-066613ea-bd24-4e59-a76f-7654c9339ddb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:45.555998 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-066613ea-bd24-4e59-a76f-7654c9339ddb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:45.568734 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-066613ea-bd24-4e59-a76f-7654c9339ddb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:45.569369 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-066613ea-bd24-4e59-a76f-7654c9339ddb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:45.569935 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-066613ea-bd24-4e59-a76f-7654c9339ddb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:45.570745 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-066613ea-bd24-4e59-a76f-7654c9339ddb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:45.571258 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-066613ea-bd24-4e59-a76f-7654c9339ddb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:45.571907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-066613ea-bd24-4e59-a76f-7654c9339ddb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:45.605618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-066613ea-bd24-4e59-a76f-7654c9339ddb tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060366 Aug 05 07:21:45.606220 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 375/764] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:21:45 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:21:45.837122 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-96416be2-a981-4ef5-b989-699019e89d3c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:45.837726 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-96416be2-a981-4ef5-b989-699019e89d3c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:45.844980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96416be2-a981-4ef5-b989-699019e89d3c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:45.845475 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96416be2-a981-4ef5-b989-699019e89d3c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:45.845906 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96416be2-a981-4ef5-b989-699019e89d3c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:45.846603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96416be2-a981-4ef5-b989-699019e89d3c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:45.847050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96416be2-a981-4ef5-b989-699019e89d3c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:45.847467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96416be2-a981-4ef5-b989-699019e89d3c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:46.006026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-96416be2-a981-4ef5-b989-699019e89d3c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:46.015969 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-96416be2-a981-4ef5-b989-699019e89d3c tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1314 microversion: 2.1 time: 0.183486 Aug 05 07:21:46.016583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 390/765] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:45 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:46.122993 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-ce77014f-52cd-422e-b077-038d4d5c0d1e req-0870d424-8e81-48a6-ae55-dbbf3d66f21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812fb9dd-0f63-44fc-abe6-cb4e71c20f37", "name": "network-vif-plugged", "status": "completed", "tag": "bd021c02-544b-45ec-8b6a-6d0e15745c25"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:46.135374 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-ce77014f-52cd-422e-b077-038d4d5c0d1e req-0870d424-8e81-48a6-ae55-dbbf3d66f21d service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:46.135936 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-ce77014f-52cd-422e-b077-038d4d5c0d1e req-0870d424-8e81-48a6-ae55-dbbf3d66f21d service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:46.136351 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-ce77014f-52cd-422e-b077-038d4d5c0d1e req-0870d424-8e81-48a6-ae55-dbbf3d66f21d service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:46.154129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-ce77014f-52cd-422e-b077-038d4d5c0d1e req-0870d424-8e81-48a6-ae55-dbbf3d66f21d service nova] Creating event network-vif-plugged:bd021c02-544b-45ec-8b6a-6d0e15745c25 for instance 812fb9dd-0f63-44fc-abe6-cb4e71c20f37 on hv-cinder-85200 Aug 05 07:21:46.160433 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-ce77014f-52cd-422e-b077-038d4d5c0d1e req-0870d424-8e81-48a6-ae55-dbbf3d66f21d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042010 Aug 05 07:21:46.161081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 376/766] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:21:46.618945 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1b8d224e-3956-4a0f-bf6a-a8adfa173059 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:46.621395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1b8d224e-3956-4a0f-bf6a-a8adfa173059 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:46.628097 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1b8d224e-3956-4a0f-bf6a-a8adfa173059 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:46.628586 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1b8d224e-3956-4a0f-bf6a-a8adfa173059 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:46.629055 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1b8d224e-3956-4a0f-bf6a-a8adfa173059 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:46.629769 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1b8d224e-3956-4a0f-bf6a-a8adfa173059 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:46.630229 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1b8d224e-3956-4a0f-bf6a-a8adfa173059 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:46.630654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1b8d224e-3956-4a0f-bf6a-a8adfa173059 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:46.665772 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1b8d224e-3956-4a0f-bf6a-a8adfa173059 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050869 Aug 05 07:21:46.666459 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 391/767] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:21:46 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:47.039176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-acd0ba84-bf22-4d8c-91c3-68b4e5c6a29e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:47.040226 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-acd0ba84-bf22-4d8c-91c3-68b4e5c6a29e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:47.049211 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acd0ba84-bf22-4d8c-91c3-68b4e5c6a29e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:47.049704 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acd0ba84-bf22-4d8c-91c3-68b4e5c6a29e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:47.050157 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acd0ba84-bf22-4d8c-91c3-68b4e5c6a29e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:47.050907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acd0ba84-bf22-4d8c-91c3-68b4e5c6a29e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:47.051364 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acd0ba84-bf22-4d8c-91c3-68b4e5c6a29e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:47.051847 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acd0ba84-bf22-4d8c-91c3-68b4e5c6a29e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:47.230133 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-acd0ba84-bf22-4d8c-91c3-68b4e5c6a29e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:47.239167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-acd0ba84-bf22-4d8c-91c3-68b4e5c6a29e tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1314 microversion: 2.1 time: 0.204656 Aug 05 07:21:47.239840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 377/768] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:47 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:47.678693 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c8357c0d-bda9-43f8-93d1-29bade14a92b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:47.680804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c8357c0d-bda9-43f8-93d1-29bade14a92b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:47.683427 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:47.684245 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=6 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:47.691110 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8357c0d-bda9-43f8-93d1-29bade14a92b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:47.691578 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8357c0d-bda9-43f8-93d1-29bade14a92b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:47.692008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8357c0d-bda9-43f8-93d1-29bade14a92b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:47.692713 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8357c0d-bda9-43f8-93d1-29bade14a92b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:47.693188 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8357c0d-bda9-43f8-93d1-29bade14a92b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:47.693610 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c8357c0d-bda9-43f8-93d1-29bade14a92b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:47.731170 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c8357c0d-bda9-43f8-93d1-29bade14a92b tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056678 Aug 05 07:21:47.731855 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 392/769] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:21:47 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 07:21:47.802376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-48451651-8094-4894-b8ef-8b30f00d0b97 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:47.802877 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-48451651-8094-4894-b8ef-8b30f00d0b97 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:47.805051 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:47.811240 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48451651-8094-4894-b8ef-8b30f00d0b97 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:47.811729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48451651-8094-4894-b8ef-8b30f00d0b97 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:47.812166 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48451651-8094-4894-b8ef-8b30f00d0b97 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:47.812883 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48451651-8094-4894-b8ef-8b30f00d0b97 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:47.813364 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48451651-8094-4894-b8ef-8b30f00d0b97 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:47.813789 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48451651-8094-4894-b8ef-8b30f00d0b97 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:47.845390 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-48451651-8094-4894-b8ef-8b30f00d0b97 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:21:47.936068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-48451651-8094-4894-b8ef-8b30f00d0b97 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 204 len: 0 microversion: 2.1 time: 0.137602 Aug 05 07:21:47.936635 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 378/770] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:21:47 2022] DELETE /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:21:47.945819 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-513970e8-1df3-4b63-8c05-f9b96e748170 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:47.946433 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-513970e8-1df3-4b63-8c05-f9b96e748170 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:47.952731 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-513970e8-1df3-4b63-8c05-f9b96e748170 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:47.953245 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-513970e8-1df3-4b63-8c05-f9b96e748170 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:47.953673 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-513970e8-1df3-4b63-8c05-f9b96e748170 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:47.954364 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-513970e8-1df3-4b63-8c05-f9b96e748170 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:47.954805 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-513970e8-1df3-4b63-8c05-f9b96e748170 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:47.955210 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-513970e8-1df3-4b63-8c05-f9b96e748170 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:48.098280 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-513970e8-1df3-4b63-8c05-f9b96e748170 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:48.107762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-513970e8-1df3-4b63-8c05-f9b96e748170 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1679 microversion: 2.1 time: 0.165805 Aug 05 07:21:48.108429 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 393/771] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:47 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:21:48.264471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7b2f1060-1b6b-4074-88ac-cc3a08fc0bd5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:48.265208 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7b2f1060-1b6b-4074-88ac-cc3a08fc0bd5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:48.267413 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:48.273455 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b2f1060-1b6b-4074-88ac-cc3a08fc0bd5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:48.273943 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b2f1060-1b6b-4074-88ac-cc3a08fc0bd5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:48.274372 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b2f1060-1b6b-4074-88ac-cc3a08fc0bd5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:48.275074 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b2f1060-1b6b-4074-88ac-cc3a08fc0bd5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:48.275523 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b2f1060-1b6b-4074-88ac-cc3a08fc0bd5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:48.275940 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b2f1060-1b6b-4074-88ac-cc3a08fc0bd5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:48.449686 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7b2f1060-1b6b-4074-88ac-cc3a08fc0bd5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:48.460183 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7b2f1060-1b6b-4074-88ac-cc3a08fc0bd5 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1314 microversion: 2.1 time: 0.201574 Aug 05 07:21:48.461251 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 379/772] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:48 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:49.129655 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-dd9baeb6-f335-4d93-80a5-ca7a1d6db3a1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:49.130527 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-dd9baeb6-f335-4d93-80a5-ca7a1d6db3a1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:49.137968 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dd9baeb6-f335-4d93-80a5-ca7a1d6db3a1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:49.138469 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dd9baeb6-f335-4d93-80a5-ca7a1d6db3a1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:49.138898 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dd9baeb6-f335-4d93-80a5-ca7a1d6db3a1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:49.139981 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dd9baeb6-f335-4d93-80a5-ca7a1d6db3a1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:49.140428 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dd9baeb6-f335-4d93-80a5-ca7a1d6db3a1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:49.140866 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-dd9baeb6-f335-4d93-80a5-ca7a1d6db3a1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:49.285979 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-dd9baeb6-f335-4d93-80a5-ca7a1d6db3a1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:49.295104 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-dd9baeb6-f335-4d93-80a5-ca7a1d6db3a1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1679 microversion: 2.1 time: 0.169352 Aug 05 07:21:49.295693 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 394/773] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:49 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:49.481668 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-06b0cb1e-f72e-42e9-b309-af4c6f2efca9 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:49.482289 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-06b0cb1e-f72e-42e9-b309-af4c6f2efca9 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:49.488641 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06b0cb1e-f72e-42e9-b309-af4c6f2efca9 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:49.489157 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06b0cb1e-f72e-42e9-b309-af4c6f2efca9 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:49.489637 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06b0cb1e-f72e-42e9-b309-af4c6f2efca9 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:49.490301 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06b0cb1e-f72e-42e9-b309-af4c6f2efca9 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:49.491391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06b0cb1e-f72e-42e9-b309-af4c6f2efca9 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:49.491391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06b0cb1e-f72e-42e9-b309-af4c6f2efca9 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:49.639637 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-06b0cb1e-f72e-42e9-b309-af4c6f2efca9 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:49.643129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:49.649779 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-06b0cb1e-f72e-42e9-b309-af4c6f2efca9 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1497 microversion: 2.1 time: 0.172299 Aug 05 07:21:49.650358 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 380/774] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:49 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:50.296549 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ba7b9491-f4af-4153-accf-41038ea6cb7d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:50.297264 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ba7b9491-f4af-4153-accf-41038ea6cb7d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:50.303996 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba7b9491-f4af-4153-accf-41038ea6cb7d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:50.304453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba7b9491-f4af-4153-accf-41038ea6cb7d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:50.304886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba7b9491-f4af-4153-accf-41038ea6cb7d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:50.305567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba7b9491-f4af-4153-accf-41038ea6cb7d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:50.306014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba7b9491-f4af-4153-accf-41038ea6cb7d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:50.306493 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba7b9491-f4af-4153-accf-41038ea6cb7d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:50.316804 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-acffe6d1-a67d-481f-8d4c-6a337ccb66e8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:50.317449 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-acffe6d1-a67d-481f-8d4c-6a337ccb66e8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:50.324115 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acffe6d1-a67d-481f-8d4c-6a337ccb66e8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:50.324596 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acffe6d1-a67d-481f-8d4c-6a337ccb66e8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:50.325032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acffe6d1-a67d-481f-8d4c-6a337ccb66e8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:50.325732 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acffe6d1-a67d-481f-8d4c-6a337ccb66e8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:50.326186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acffe6d1-a67d-481f-8d4c-6a337ccb66e8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:50.327050 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acffe6d1-a67d-481f-8d4c-6a337ccb66e8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:50.333331 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ba7b9491-f4af-4153-accf-41038ea6cb7d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Going to try to terminate instance {{(pid=117894) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:21:50.426817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ba7b9491-f4af-4153-accf-41038ea6cb7d tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "DELETE /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 204 len: 0 microversion: 2.1 time: 0.133893 Aug 05 07:21:50.427783 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 395/775] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:21:50 2022] DELETE /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:21:50.439359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ba7204ee-2185-4746-838e-820102c14fb2 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:50.440558 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ba7204ee-2185-4746-838e-820102c14fb2 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:50.446982 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba7204ee-2185-4746-838e-820102c14fb2 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:50.447505 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba7204ee-2185-4746-838e-820102c14fb2 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:50.448000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba7204ee-2185-4746-838e-820102c14fb2 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:50.448701 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba7204ee-2185-4746-838e-820102c14fb2 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:50.449183 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba7204ee-2185-4746-838e-820102c14fb2 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:50.449602 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba7204ee-2185-4746-838e-820102c14fb2 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:50.477072 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-acffe6d1-a67d-481f-8d4c-6a337ccb66e8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:50.485957 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-acffe6d1-a67d-481f-8d4c-6a337ccb66e8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1679 microversion: 2.1 time: 0.173365 Aug 05 07:21:50.486941 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 381/776] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:50 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:21:50.607167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ba7204ee-2185-4746-838e-820102c14fb2 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:50.615969 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ba7204ee-2185-4746-838e-820102c14fb2 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1503 microversion: 2.1 time: 0.182510 Aug 05 07:21:50.616833 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 396/777] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:50 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:51.507528 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-56773069-d098-4a1e-a982-f7d910cf5380 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:51.508176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-56773069-d098-4a1e-a982-f7d910cf5380 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:51.515751 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56773069-d098-4a1e-a982-f7d910cf5380 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:51.516230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56773069-d098-4a1e-a982-f7d910cf5380 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:51.516652 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56773069-d098-4a1e-a982-f7d910cf5380 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:51.517466 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56773069-d098-4a1e-a982-f7d910cf5380 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:51.517913 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56773069-d098-4a1e-a982-f7d910cf5380 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:51.518322 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56773069-d098-4a1e-a982-f7d910cf5380 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:51.643219 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8edee039-19cb-4c2f-b370-dc88ab49d45a tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:51.644374 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8edee039-19cb-4c2f-b370-dc88ab49d45a tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:51.657006 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8edee039-19cb-4c2f-b370-dc88ab49d45a tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:51.657777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8edee039-19cb-4c2f-b370-dc88ab49d45a tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:51.658436 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8edee039-19cb-4c2f-b370-dc88ab49d45a tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:51.659536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8edee039-19cb-4c2f-b370-dc88ab49d45a tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:51.660246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8edee039-19cb-4c2f-b370-dc88ab49d45a tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:51.660931 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8edee039-19cb-4c2f-b370-dc88ab49d45a tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:51.668977 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-56773069-d098-4a1e-a982-f7d910cf5380 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:51.680986 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-56773069-d098-4a1e-a982-f7d910cf5380 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1679 microversion: 2.1 time: 0.174255 Aug 05 07:21:51.683235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 382/778] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:51 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:51.837877 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-8edee039-19cb-4c2f-b370-dc88ab49d45a tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:51.854792 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8edee039-19cb-4c2f-b370-dc88ab49d45a tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1503 microversion: 2.1 time: 0.220117 Aug 05 07:21:51.855446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 397/779] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:51 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:21:52.700318 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d7bc3668-91bc-4af0-ab5a-ce2635a7d7a2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:52.701212 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d7bc3668-91bc-4af0-ab5a-ce2635a7d7a2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:52.712880 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d7bc3668-91bc-4af0-ab5a-ce2635a7d7a2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:52.713701 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d7bc3668-91bc-4af0-ab5a-ce2635a7d7a2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:52.714321 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d7bc3668-91bc-4af0-ab5a-ce2635a7d7a2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:52.715546 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d7bc3668-91bc-4af0-ab5a-ce2635a7d7a2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:52.716755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d7bc3668-91bc-4af0-ab5a-ce2635a7d7a2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:52.717488 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d7bc3668-91bc-4af0-ab5a-ce2635a7d7a2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:52.827221 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d7bc3668-91bc-4af0-ab5a-ce2635a7d7a2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:52.846211 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d7bc3668-91bc-4af0-ab5a-ce2635a7d7a2 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1613 microversion: 2.1 time: 0.149738 Aug 05 07:21:52.847155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 383/780] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:52 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1613 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:21:52.876477 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-34fd9cf1-9f39-4e8b-b610-26a51d03c5a4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:52.877226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-34fd9cf1-9f39-4e8b-b610-26a51d03c5a4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:52.906486 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34fd9cf1-9f39-4e8b-b610-26a51d03c5a4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:52.907581 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34fd9cf1-9f39-4e8b-b610-26a51d03c5a4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:52.909081 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34fd9cf1-9f39-4e8b-b610-26a51d03c5a4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:52.910497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34fd9cf1-9f39-4e8b-b610-26a51d03c5a4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:52.911040 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34fd9cf1-9f39-4e8b-b610-26a51d03c5a4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:52.911582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34fd9cf1-9f39-4e8b-b610-26a51d03c5a4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:52.954325 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-36a1fbbc-26e4-49dc-aa69-fe9e396d4191 req-6e0fc924-c25d-44ca-af9e-cddcd60e5c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812fb9dd-0f63-44fc-abe6-cb4e71c20f37", "name": "network-vif-deleted", "tag": "bd021c02-544b-45ec-8b6a-6d0e15745c25"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:52.965129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-36a1fbbc-26e4-49dc-aa69-fe9e396d4191 req-6e0fc924-c25d-44ca-af9e-cddcd60e5c28 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:52.965962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-36a1fbbc-26e4-49dc-aa69-fe9e396d4191 req-6e0fc924-c25d-44ca-af9e-cddcd60e5c28 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:52.966657 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-36a1fbbc-26e4-49dc-aa69-fe9e396d4191 req-6e0fc924-c25d-44ca-af9e-cddcd60e5c28 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:52.980223 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-36a1fbbc-26e4-49dc-aa69-fe9e396d4191 req-6e0fc924-c25d-44ca-af9e-cddcd60e5c28 service nova] Creating event network-vif-deleted:bd021c02-544b-45ec-8b6a-6d0e15745c25 for instance 812fb9dd-0f63-44fc-abe6-cb4e71c20f37 on hv-cinder-85200 Aug 05 07:21:52.986151 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-36a1fbbc-26e4-49dc-aa69-fe9e396d4191 req-6e0fc924-c25d-44ca-af9e-cddcd60e5c28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036929 Aug 05 07:21:52.991902 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 384/781] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:53.003539 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-34fd9cf1-9f39-4e8b-b610-26a51d03c5a4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61cfea5a8c44105bbb2906fff46df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af97b401094c4317b62595ea76cdd6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:53.016189 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-34fd9cf1-9f39-4e8b-b610-26a51d03c5a4 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 200 len: 1461 microversion: 2.1 time: 0.143812 Aug 05 07:21:53.016909 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 398/782] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:52 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 1461 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:21:53.873634 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:53.874558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:53.882251 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:53.882740 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:53.883173 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:53.883902 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:53.884353 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:53.884784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:53.925639 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:53.926390 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:53.927662 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:53.928443 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lazy-loading 'fault' on Instance uuid 001d9229-32a3-4aa2-9e7d-c4d306c30d49 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:21:53.991740 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:54.003614 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2a414501-0614-487f-a32c-2a662da4fc03 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 200 len: 1332 microversion: 2.1 time: 0.135354 Aug 05 07:21:54.004209 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 385/783] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:53 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 1332 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:54.037685 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6a65b620-abc1-492e-924a-0857a09b0a30 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:54.038302 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-6a65b620-abc1-492e-924a-0857a09b0a30 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] [instance: 812fb9dd-0f63-44fc-abe6-cb4e71c20f37] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:54.046335 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6a65b620-abc1-492e-924a-0857a09b0a30 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:54.047198 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6a65b620-abc1-492e-924a-0857a09b0a30 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:54.047625 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6a65b620-abc1-492e-924a-0857a09b0a30 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:54.048582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6a65b620-abc1-492e-924a-0857a09b0a30 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:54.049073 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6a65b620-abc1-492e-924a-0857a09b0a30 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:54.049493 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6a65b620-abc1-492e-924a-0857a09b0a30 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:54.066187 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-6a65b620-abc1-492e-924a-0857a09b0a30 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] HTTP exception thrown: Instance 812fb9dd-0f63-44fc-abe6-cb4e71c20f37 could not be found. Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6a65b620-abc1-492e-924a-0857a09b0a30 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Request method failure captured: Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 HTTP/1.1 Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MTrQSgUupcEJTZw3p76SMuq_rxsDepv5QdlTk-d8rTUHfDIeC7LMejQ7OYvelA6tT22MvKolja4FOFYPVM3q0CAuNZeiGADZ05oNr3xmWK9RxGfqr4_921E_pyCS96olJe5P8galJ4k6amOacHoiuRQNpv_9Df6hN-fNuPfD8QrRqQ Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: af97b401094c4317b62595ea76cdd6ec Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-VolumesActionsTest-1693050960 Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:21:54.067916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:21:54.069873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_af97b401094c4317b62595ea76cdd6ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af97b401094c4317b62595ea76cdd6ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af97b401094c4317b62595ea76cdd6ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/af97b401094c4317b62595ea76cdd6ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:21:54.069873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-VolumesActionsTest-1693050960 Aug 05 07:21:54.069873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: af97b401094c4317b62595ea76cdd6ec Aug 05 07:21:54.069873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-VolumesActionsTest-1693050960 Aug 05 07:21:54.069873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-VolumesActionsTest-1693050960-project Aug 05 07:21:54.069873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:21:54.069873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:21:54.069873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: e61cfea5a8c44105bbb2906fff46df7b Aug 05 07:21:54.069873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-VolumesActionsTest-1693050960-project Aug 05 07:21:54.069873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:21:54.069873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance 812fb9dd-0f63-44fc-abe6-cb4e71c20f37 could not be found. Aug 05 07:21:54.069873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': '812fb9dd-0f63-44fc-abe6-cb4e71c20f37'} Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 812fb9dd-0f63-44fc-abe6-cb4e71c20f37 could not be found. Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:21:54.070791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 812fb9dd-0f63-44fc-abe6-cb4e71c20f37 could not be found. Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 812fb9dd-0f63-44fc-abe6-cb4e71c20f37 could not be found. Aug 05 07:21:54.072626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:21:54.074746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6a65b620-abc1-492e-924a-0857a09b0a30 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] Returning 404 to user: Instance 812fb9dd-0f63-44fc-abe6-cb4e71c20f37 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:21:54.074746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-6a65b620-abc1-492e-924a-0857a09b0a30 tempest-VolumesActionsTest-1693050960 tempest-VolumesActionsTest-1693050960-project] 10.222.0.27 "GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37" status: 404 len: 111 microversion: 2.1 time: 0.035809 Aug 05 07:21:54.074746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 399/784] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:54 2022] GET /compute/v2.1/servers/812fb9dd-0f63-44fc-abe6-cb4e71c20f37 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 07:21:55.000790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-66b68340-e6f5-4b05-8486-cf4b46538b01 req-788d5c3d-d432-4aa4-8fb2-ed33ee64b63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001d9229-32a3-4aa2-9e7d-c4d306c30d49", "name": "network-vif-deleted", "tag": "e676ac49-a459-400f-a384-382ed69aec25"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:55.011338 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-66b68340-e6f5-4b05-8486-cf4b46538b01 req-788d5c3d-d432-4aa4-8fb2-ed33ee64b63a service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:55.011805 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-66b68340-e6f5-4b05-8486-cf4b46538b01 req-788d5c3d-d432-4aa4-8fb2-ed33ee64b63a service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:55.012238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-66b68340-e6f5-4b05-8486-cf4b46538b01 req-788d5c3d-d432-4aa4-8fb2-ed33ee64b63a service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:55.026378 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-66b68340-e6f5-4b05-8486-cf4b46538b01 req-788d5c3d-d432-4aa4-8fb2-ed33ee64b63a service nova] Creating event network-vif-deleted:e676ac49-a459-400f-a384-382ed69aec25 for instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 on hv-cinder-85200 Aug 05 07:21:55.026745 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-220d6552-760d-4957-9dbb-03982eaca2d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:55.027379 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-220d6552-760d-4957-9dbb-03982eaca2d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:55.031751 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-66b68340-e6f5-4b05-8486-cf4b46538b01 req-788d5c3d-d432-4aa4-8fb2-ed33ee64b63a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034273 Aug 05 07:21:55.032683 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 386/785] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:55.033889 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-220d6552-760d-4957-9dbb-03982eaca2d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:55.034509 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-220d6552-760d-4957-9dbb-03982eaca2d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:55.034905 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-220d6552-760d-4957-9dbb-03982eaca2d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:55.035513 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-220d6552-760d-4957-9dbb-03982eaca2d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:55.035967 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-220d6552-760d-4957-9dbb-03982eaca2d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:55.036392 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-220d6552-760d-4957-9dbb-03982eaca2d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:55.053894 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-220d6552-760d-4957-9dbb-03982eaca2d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-220d6552-760d-4957-9dbb-03982eaca2d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 HTTP/1.1 Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:21:55.055453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:21:55.057020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:21:55.057020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:21:55.057020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:21:55.057020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:21:55.057020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:21:55.057020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:21:55.057020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:21:55.057020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:21:55.057020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:21:55.057020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:21:55.057020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:21:55.057020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': '001d9229-32a3-4aa2-9e7d-c4d306c30d49'} Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:21:55.057796 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:21:55.059755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:21:55.061264 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-220d6552-760d-4957-9dbb-03982eaca2d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 404 to user: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:21:55.061264 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-220d6552-760d-4957-9dbb-03982eaca2d9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 404 len: 111 microversion: 2.1 time: 0.034297 Aug 05 07:21:55.061264 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 400/786] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:55 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 07:21:55.067856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-99e07c2c-08c5-4d1a-b798-ce7a2066f6a4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '.version_select at 0x7f49705b54c0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:55.091151 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-99e07c2c-08c5-4d1a-b798-ce7a2066f6a4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2070060702" status: 202 len: 0 microversion: 2.1 time: 0.028086 Aug 05 07:21:55.095344 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 387/787] 10.222.0.27 () {58 vars in 1221 bytes} [Fri Aug 5 07:21:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2070060702 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 07:21:55.828519 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-04ea771f-849c-489f-8816-f106c002bd6e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: .version_select at 0x7f49747bb4c0>, body: {"keypair": {"name": "tempest-keypair-2093920548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgRS4cHmrOwEgtYIwtogBIIAwIOhhS5vr5cuz7D0+LQ10zH7Ds3kkKOM7l+iJQ77NY35mM3s6vzWlZ+mJ/Dj/sNdI8FNmmWbkvXx131EKS1sZjDvS/Fk3VKZwVKixBtfw=="}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:55.851601 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-04ea771f-849c-489f-8816-f106c002bd6e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for project 61bf4a49abd8479f895e68d4954412b2. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:21:55.865957 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-04ea771f-849c-489f-8816-f106c002bd6e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for user 096d0da1a0bc401c95bfbb8fc150a27b and project 61bf4a49abd8479f895e68d4954412b2. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:21:55.897083 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-04ea771f-849c-489f-8816-f106c002bd6e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072411 Aug 05 07:21:55.898054 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 401/788] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 5 07:21:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:21:57.433427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2131986324", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "470083bd-345d-480f-9634-dd509ffd0df2"}], "security_groups": [{"name": "tempest-securitygroup--1558392160"}], "key_name": "tempest-keypair-2093920548", "user_data": "}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:21:57.554707 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] validate_networks() for [('470083bd-345d-480f-9634-dd509ffd0df2', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:21:58.006424 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:21:58.006840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:21:58.007302 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:21:58.007706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:21:58.008079 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:21:58.019920 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:58.020544 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:58.021175 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:58.021997 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:58.022533 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:58.023092 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:58.043540 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for project 61bf4a49abd8479f895e68d4954412b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:21:58.048117 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Getting quotas for user 096d0da1a0bc401c95bfbb8fc150a27b and project 61bf4a49abd8479f895e68d4954412b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:21:58.059899 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:21:58.062423 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:21:58.118025 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f73846fe-e9a3-4444-bc2a-0af7d3cc95f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.689766 Aug 05 07:21:58.118693 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 388/789] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:21:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:21:58.130447 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-150b560a-1e8b-4414-90a0-c579b5109813 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:58.131211 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-150b560a-1e8b-4414-90a0-c579b5109813 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:58.194278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-150b560a-1e8b-4414-90a0-c579b5109813 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:58.203131 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-150b560a-1e8b-4414-90a0-c579b5109813 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1242 microversion: 2.1 time: 0.077251 Aug 05 07:21:58.203726 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 402/790] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:58 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:21:59.224693 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ca74c04e-936e-4b91-9bd6-fcefe8ab77ee tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:21:59.225367 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ca74c04e-936e-4b91-9bd6-fcefe8ab77ee tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:21:59.232712 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca74c04e-936e-4b91-9bd6-fcefe8ab77ee tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:59.233231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca74c04e-936e-4b91-9bd6-fcefe8ab77ee tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:59.233662 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca74c04e-936e-4b91-9bd6-fcefe8ab77ee tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:59.234371 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca74c04e-936e-4b91-9bd6-fcefe8ab77ee tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:21:59.234818 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca74c04e-936e-4b91-9bd6-fcefe8ab77ee tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:21:59.235235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca74c04e-936e-4b91-9bd6-fcefe8ab77ee tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:21:59.301734 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ca74c04e-936e-4b91-9bd6-fcefe8ab77ee tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:21:59.309675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ca74c04e-936e-4b91-9bd6-fcefe8ab77ee tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1294 microversion: 2.1 time: 0.089469 Aug 05 07:21:59.310272 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 389/791] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:21:59 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:22:00.331077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-91c8c210-1a31-4941-9ab7-de0ef0a2adc7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:00.332014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-91c8c210-1a31-4941-9ab7-de0ef0a2adc7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:00.344354 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91c8c210-1a31-4941-9ab7-de0ef0a2adc7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:00.344855 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91c8c210-1a31-4941-9ab7-de0ef0a2adc7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:00.349690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91c8c210-1a31-4941-9ab7-de0ef0a2adc7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:00.350824 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91c8c210-1a31-4941-9ab7-de0ef0a2adc7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:00.351528 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91c8c210-1a31-4941-9ab7-de0ef0a2adc7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:00.352124 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91c8c210-1a31-4941-9ab7-de0ef0a2adc7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:00.615746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-91c8c210-1a31-4941-9ab7-de0ef0a2adc7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:00.619089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:00.629868 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-91c8c210-1a31-4941-9ab7-de0ef0a2adc7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1368 microversion: 2.1 time: 0.302596 Aug 05 07:22:00.631226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 403/792] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:22:00 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1368 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:22:01.245412 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-002d2fb0-6e10-4c94-8cc8-0c44755bd1cf req-56820a37-8d35-4bd3-808d-559de0807211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3696e06-e4c3-4ec1-8066-c5d225e93178", "tag": "3291dc18-378f-4672-bcf1-88fbe937b2ef"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:22:01.269974 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-002d2fb0-6e10-4c94-8cc8-0c44755bd1cf req-56820a37-8d35-4bd3-808d-559de0807211 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:01.270853 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-002d2fb0-6e10-4c94-8cc8-0c44755bd1cf req-56820a37-8d35-4bd3-808d-559de0807211 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:01.271419 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-002d2fb0-6e10-4c94-8cc8-0c44755bd1cf req-56820a37-8d35-4bd3-808d-559de0807211 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:01.289040 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-002d2fb0-6e10-4c94-8cc8-0c44755bd1cf req-56820a37-8d35-4bd3-808d-559de0807211 service nova] Creating event network-changed:3291dc18-378f-4672-bcf1-88fbe937b2ef for instance a3696e06-e4c3-4ec1-8066-c5d225e93178 on hv-cinder-85200 Aug 05 07:22:01.295630 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-002d2fb0-6e10-4c94-8cc8-0c44755bd1cf req-56820a37-8d35-4bd3-808d-559de0807211 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066652 Aug 05 07:22:01.296887 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 390/793] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:22:01.653577 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-fab12909-234b-48ce-a9e4-cebf16700da9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:01.655288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-fab12909-234b-48ce-a9e4-cebf16700da9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:01.664689 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fab12909-234b-48ce-a9e4-cebf16700da9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:01.665719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fab12909-234b-48ce-a9e4-cebf16700da9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:01.666361 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fab12909-234b-48ce-a9e4-cebf16700da9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:01.667386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fab12909-234b-48ce-a9e4-cebf16700da9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:01.667907 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fab12909-234b-48ce-a9e4-cebf16700da9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:01.668328 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fab12909-234b-48ce-a9e4-cebf16700da9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:01.871548 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-fab12909-234b-48ce-a9e4-cebf16700da9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:01.879861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-fab12909-234b-48ce-a9e4-cebf16700da9 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1368 microversion: 2.1 time: 0.231616 Aug 05 07:22:01.899991 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 404/794] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:22:01 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:22:02.910109 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9f26f776-da53-4974-9cb1-698397bd1e8d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:02.911554 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9f26f776-da53-4974-9cb1-698397bd1e8d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:02.921498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9f26f776-da53-4974-9cb1-698397bd1e8d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:02.922876 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9f26f776-da53-4974-9cb1-698397bd1e8d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:02.923891 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9f26f776-da53-4974-9cb1-698397bd1e8d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:02.925700 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9f26f776-da53-4974-9cb1-698397bd1e8d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:02.926746 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9f26f776-da53-4974-9cb1-698397bd1e8d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:02.927739 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9f26f776-da53-4974-9cb1-698397bd1e8d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:03.177592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9f26f776-da53-4974-9cb1-698397bd1e8d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:03.186759 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9f26f776-da53-4974-9cb1-698397bd1e8d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1368 microversion: 2.1 time: 0.282349 Aug 05 07:22:03.188069 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 391/795] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:22:02 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:22:04.208570 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ad1284d6-bea8-471e-998a-f86ac192db30 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:04.209984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ad1284d6-bea8-471e-998a-f86ac192db30 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:04.218248 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad1284d6-bea8-471e-998a-f86ac192db30 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:04.218759 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad1284d6-bea8-471e-998a-f86ac192db30 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:04.219188 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad1284d6-bea8-471e-998a-f86ac192db30 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:04.220160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad1284d6-bea8-471e-998a-f86ac192db30 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:04.220719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad1284d6-bea8-471e-998a-f86ac192db30 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:04.221073 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad1284d6-bea8-471e-998a-f86ac192db30 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:04.375832 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ad1284d6-bea8-471e-998a-f86ac192db30 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:04.387316 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ad1284d6-bea8-471e-998a-f86ac192db30 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1368 microversion: 2.1 time: 0.183173 Aug 05 07:22:04.397357 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 405/796] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:22:04 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:22:05.413998 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0a0c00c5-7f18-424d-9376-47d873ea44df tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:05.415559 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0a0c00c5-7f18-424d-9376-47d873ea44df tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:05.423146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a0c00c5-7f18-424d-9376-47d873ea44df tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:05.423867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a0c00c5-7f18-424d-9376-47d873ea44df tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:05.424376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a0c00c5-7f18-424d-9376-47d873ea44df tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:05.425442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a0c00c5-7f18-424d-9376-47d873ea44df tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:05.426012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a0c00c5-7f18-424d-9376-47d873ea44df tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:05.426978 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a0c00c5-7f18-424d-9376-47d873ea44df tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:05.652881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0a0c00c5-7f18-424d-9376-47d873ea44df tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:05.668077 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0a0c00c5-7f18-424d-9376-47d873ea44df tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1368 microversion: 2.1 time: 0.260097 Aug 05 07:22:05.668692 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 392/797] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:22:05 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:22:06.689832 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-096bc3f2-49ba-46a5-a030-4f31aa1b3daf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:06.691391 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-096bc3f2-49ba-46a5-a030-4f31aa1b3daf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:06.703626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:06.706326 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-096bc3f2-49ba-46a5-a030-4f31aa1b3daf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:06.707174 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-096bc3f2-49ba-46a5-a030-4f31aa1b3daf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:06.707896 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-096bc3f2-49ba-46a5-a030-4f31aa1b3daf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:06.708852 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-096bc3f2-49ba-46a5-a030-4f31aa1b3daf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:06.709561 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-096bc3f2-49ba-46a5-a030-4f31aa1b3daf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:06.710184 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-096bc3f2-49ba-46a5-a030-4f31aa1b3daf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:06.938645 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-096bc3f2-49ba-46a5-a030-4f31aa1b3daf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:06.947899 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-096bc3f2-49ba-46a5-a030-4f31aa1b3daf tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1368 microversion: 2.1 time: 0.262103 Aug 05 07:22:06.949298 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 406/798] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:22:06 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:22:07.712126 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-cbfca22d-0f1b-499b-8f3c-0b0e965d64d4 req-f171d970-e163-436a-a111-7560f9424512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3696e06-e4c3-4ec1-8066-c5d225e93178", "name": "network-vif-plugged", "status": "completed", "tag": "3291dc18-378f-4672-bcf1-88fbe937b2ef"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:22:07.732489 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-cbfca22d-0f1b-499b-8f3c-0b0e965d64d4 req-f171d970-e163-436a-a111-7560f9424512 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:07.733547 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-cbfca22d-0f1b-499b-8f3c-0b0e965d64d4 req-f171d970-e163-436a-a111-7560f9424512 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:07.734404 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-cbfca22d-0f1b-499b-8f3c-0b0e965d64d4 req-f171d970-e163-436a-a111-7560f9424512 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:07.748807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-cbfca22d-0f1b-499b-8f3c-0b0e965d64d4 req-f171d970-e163-436a-a111-7560f9424512 service nova] Creating event network-vif-plugged:3291dc18-378f-4672-bcf1-88fbe937b2ef for instance a3696e06-e4c3-4ec1-8066-c5d225e93178 on hv-cinder-85200 Aug 05 07:22:07.756814 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-cbfca22d-0f1b-499b-8f3c-0b0e965d64d4 req-f171d970-e163-436a-a111-7560f9424512 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049613 Aug 05 07:22:07.758175 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 393/799] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:22:07.978984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8f8b57ff-e335-4c4c-9857-2f5c2507c44d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:07.980362 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8f8b57ff-e335-4c4c-9857-2f5c2507c44d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:07.994090 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8f8b57ff-e335-4c4c-9857-2f5c2507c44d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:07.995096 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8f8b57ff-e335-4c4c-9857-2f5c2507c44d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:07.995961 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8f8b57ff-e335-4c4c-9857-2f5c2507c44d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:07.997630 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8f8b57ff-e335-4c4c-9857-2f5c2507c44d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:07.998903 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8f8b57ff-e335-4c4c-9857-2f5c2507c44d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:08.000020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8f8b57ff-e335-4c4c-9857-2f5c2507c44d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:08.199788 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=6 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:08.208735 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-8f8b57ff-e335-4c4c-9857-2f5c2507c44d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:08.227500 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8f8b57ff-e335-4c4c-9857-2f5c2507c44d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1368 microversion: 2.1 time: 0.254622 Aug 05 07:22:08.227500 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 407/800] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:22:07 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:22:09.251525 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:09.253556 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:09.262237 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-aa21820e-3cf7-4901-a4b4-bf7c2670d16d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:09.263977 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-aa21820e-3cf7-4901-a4b4-bf7c2670d16d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:09.274666 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa21820e-3cf7-4901-a4b4-bf7c2670d16d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:09.275261 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa21820e-3cf7-4901-a4b4-bf7c2670d16d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:09.276061 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa21820e-3cf7-4901-a4b4-bf7c2670d16d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:09.277343 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa21820e-3cf7-4901-a4b4-bf7c2670d16d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:09.278171 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa21820e-3cf7-4901-a4b4-bf7c2670d16d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:09.279010 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa21820e-3cf7-4901-a4b4-bf7c2670d16d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:09.495500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aa21820e-3cf7-4901-a4b4-bf7c2670d16d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:09.504112 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-aa21820e-3cf7-4901-a4b4-bf7c2670d16d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1368 microversion: 2.1 time: 0.254252 Aug 05 07:22:09.504616 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 394/801] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:22:09 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:22:10.534790 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-db9f0c25-f40a-414a-b641-b1f4b746ba3f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:10.536185 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-db9f0c25-f40a-414a-b641-b1f4b746ba3f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:10.552224 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db9f0c25-f40a-414a-b641-b1f4b746ba3f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:10.552870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db9f0c25-f40a-414a-b641-b1f4b746ba3f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:10.553771 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db9f0c25-f40a-414a-b641-b1f4b746ba3f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:10.554674 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db9f0c25-f40a-414a-b641-b1f4b746ba3f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:10.555291 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db9f0c25-f40a-414a-b641-b1f4b746ba3f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:10.555836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db9f0c25-f40a-414a-b641-b1f4b746ba3f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:10.825536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-db9f0c25-f40a-414a-b641-b1f4b746ba3f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:10.840700 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-db9f0c25-f40a-414a-b641-b1f4b746ba3f tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1558 microversion: 2.1 time: 0.312569 Aug 05 07:22:10.842179 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 408/802] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:22:10 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1558 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:22:10.874775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cd921344-25ea-451e-a1bf-e625b494cd04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:10.876691 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cd921344-25ea-451e-a1bf-e625b494cd04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:10.887612 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cd921344-25ea-451e-a1bf-e625b494cd04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:10.889347 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cd921344-25ea-451e-a1bf-e625b494cd04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:10.890320 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cd921344-25ea-451e-a1bf-e625b494cd04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:10.891608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cd921344-25ea-451e-a1bf-e625b494cd04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:10.892339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cd921344-25ea-451e-a1bf-e625b494cd04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:10.893305 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cd921344-25ea-451e-a1bf-e625b494cd04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:10.999557 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cd921344-25ea-451e-a1bf-e625b494cd04 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130476 Aug 05 07:22:11.000164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 395/803] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Aug 5 07:22:10 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:22:12.631499 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-04d8a010-4022-4d24-87dd-467c4bca4cd0 req-308be9de-e837-496e-a3ae-535c393e16ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3696e06-e4c3-4ec1-8066-c5d225e93178", "tag": "3291dc18-378f-4672-bcf1-88fbe937b2ef"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:22:12.643772 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-04d8a010-4022-4d24-87dd-467c4bca4cd0 req-308be9de-e837-496e-a3ae-535c393e16ac service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:12.644250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-04d8a010-4022-4d24-87dd-467c4bca4cd0 req-308be9de-e837-496e-a3ae-535c393e16ac service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:12.644676 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-04d8a010-4022-4d24-87dd-467c4bca4cd0 req-308be9de-e837-496e-a3ae-535c393e16ac service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:12.657056 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-04d8a010-4022-4d24-87dd-467c4bca4cd0 req-308be9de-e837-496e-a3ae-535c393e16ac service nova] Creating event network-changed:3291dc18-378f-4672-bcf1-88fbe937b2ef for instance a3696e06-e4c3-4ec1-8066-c5d225e93178 on hv-cinder-85200 Aug 05 07:22:12.662478 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-04d8a010-4022-4d24-87dd-467c4bca4cd0 req-308be9de-e837-496e-a3ae-535c393e16ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034388 Aug 05 07:22:12.663416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 409/804] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:22:51.188142 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:51.188956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=64 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:51.193866 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-63a25306-dfee-45ea-89a7-bfd5ac01a00f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:51.194359 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-63a25306-dfee-45ea-89a7-bfd5ac01a00f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:51.202673 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63a25306-dfee-45ea-89a7-bfd5ac01a00f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:51.203157 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63a25306-dfee-45ea-89a7-bfd5ac01a00f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:51.203580 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63a25306-dfee-45ea-89a7-bfd5ac01a00f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:51.204492 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63a25306-dfee-45ea-89a7-bfd5ac01a00f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:51.204943 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63a25306-dfee-45ea-89a7-bfd5ac01a00f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:51.205389 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63a25306-dfee-45ea-89a7-bfd5ac01a00f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:51.231842 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-63a25306-dfee-45ea-89a7-bfd5ac01a00f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/ips" status: 200 len: 152 microversion: 2.20 time: 0.045090 Aug 05 07:22:51.232470 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 396/805] 10.222.0.27 () {60 vars in 1289 bytes} [Fri Aug 5 07:22:51 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:22:53.695484 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-591b9e05-db5c-4473-ac3a-95f797e55245 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:22:53.696240 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-591b9e05-db5c-4473-ac3a-95f797e55245 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:53.703530 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=7 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:53.704215 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=33 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:53.706093 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-591b9e05-db5c-4473-ac3a-95f797e55245 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:53.706586 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-591b9e05-db5c-4473-ac3a-95f797e55245 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:53.707049 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-591b9e05-db5c-4473-ac3a-95f797e55245 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:53.707740 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-591b9e05-db5c-4473-ac3a-95f797e55245 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:53.708284 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-591b9e05-db5c-4473-ac3a-95f797e55245 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:53.708745 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-591b9e05-db5c-4473-ac3a-95f797e55245 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:53.737635 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-591b9e05-db5c-4473-ac3a-95f797e55245 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lazy-loading 'flavor' on Instance uuid 5d197c94-dfa3-4fe2-974d-4134fb0cb595 {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:22:53.993874 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-591b9e05-db5c-4473-ac3a-95f797e55245 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "POST /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/action" status: 202 len: 0 microversion: 2.20 time: 0.304432 Aug 05 07:22:53.994496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 410/806] 10.222.0.27 () {62 vars in 1319 bytes} [Fri Aug 5 07:22:53 2022] POST /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:22:54.003526 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f77df7a4-e7c7-49b3-a6c8-cace14a9df5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:54.003982 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f77df7a4-e7c7-49b3-a6c8-cace14a9df5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:54.015013 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f77df7a4-e7c7-49b3-a6c8-cace14a9df5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:54.018137 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f77df7a4-e7c7-49b3-a6c8-cace14a9df5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:54.019196 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f77df7a4-e7c7-49b3-a6c8-cace14a9df5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:54.020150 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f77df7a4-e7c7-49b3-a6c8-cace14a9df5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:54.020626 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f77df7a4-e7c7-49b3-a6c8-cace14a9df5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:54.021113 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f77df7a4-e7c7-49b3-a6c8-cace14a9df5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:54.282997 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f77df7a4-e7c7-49b3-a6c8-cace14a9df5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:54.297548 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f77df7a4-e7c7-49b3-a6c8-cace14a9df5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:54.299554 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f77df7a4-e7c7-49b3-a6c8-cace14a9df5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:54.301090 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f77df7a4-e7c7-49b3-a6c8-cace14a9df5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.301720 Aug 05 07:22:54.302275 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 397/807] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:22:53 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:22:54.990724 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8cca66a5-54b7-42f5-a23e-ecf4dd74db15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:54.991991 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8cca66a5-54b7-42f5-a23e-ecf4dd74db15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:54.998668 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8cca66a5-54b7-42f5-a23e-ecf4dd74db15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:54.999150 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8cca66a5-54b7-42f5-a23e-ecf4dd74db15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:54.999571 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8cca66a5-54b7-42f5-a23e-ecf4dd74db15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:55.000272 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8cca66a5-54b7-42f5-a23e-ecf4dd74db15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:55.000910 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8cca66a5-54b7-42f5-a23e-ecf4dd74db15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:55.001481 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8cca66a5-54b7-42f5-a23e-ecf4dd74db15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:55.052819 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8cca66a5-54b7-42f5-a23e-ecf4dd74db15 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/ips" status: 200 len: 144 microversion: 2.1 time: 0.066894 Aug 05 07:22:55.054135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 411/808] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 5 07:22:54 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/ips => generated 144 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:22:55.327218 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3bda5a36-a1e5-4c5b-9ac2-48731419234f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:55.328215 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3bda5a36-a1e5-4c5b-9ac2-48731419234f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:55.341899 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bda5a36-a1e5-4c5b-9ac2-48731419234f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:55.342779 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bda5a36-a1e5-4c5b-9ac2-48731419234f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:55.343361 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bda5a36-a1e5-4c5b-9ac2-48731419234f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:55.344135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bda5a36-a1e5-4c5b-9ac2-48731419234f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:55.344824 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bda5a36-a1e5-4c5b-9ac2-48731419234f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:55.345449 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bda5a36-a1e5-4c5b-9ac2-48731419234f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:55.628229 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3bda5a36-a1e5-4c5b-9ac2-48731419234f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:55.638221 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3bda5a36-a1e5-4c5b-9ac2-48731419234f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:55.639860 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3bda5a36-a1e5-4c5b-9ac2-48731419234f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:55.641203 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3bda5a36-a1e5-4c5b-9ac2-48731419234f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.318962 Aug 05 07:22:55.642116 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 398/809] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:22:55 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:22:56.634230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-661265cd-81a7-4b42-96a6-4a2805e86ad2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd8bca92-3856-4246-bdca-99fdad021080"}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:22:56.637348 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-661265cd-81a7-4b42-96a6-4a2805e86ad2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:56.646332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-661265cd-81a7-4b42-96a6-4a2805e86ad2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:56.647217 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-661265cd-81a7-4b42-96a6-4a2805e86ad2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:56.647797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-661265cd-81a7-4b42-96a6-4a2805e86ad2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:56.648630 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-661265cd-81a7-4b42-96a6-4a2805e86ad2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:56.649230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-661265cd-81a7-4b42-96a6-4a2805e86ad2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:56.649780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-661265cd-81a7-4b42-96a6-4a2805e86ad2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:56.669882 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-039afe49-3a1c-4fe3-af68-576667b7fa03 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:56.671375 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-039afe49-3a1c-4fe3-af68-576667b7fa03 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:56.679907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-039afe49-3a1c-4fe3-af68-576667b7fa03 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:56.680767 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-039afe49-3a1c-4fe3-af68-576667b7fa03 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:56.681221 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-039afe49-3a1c-4fe3-af68-576667b7fa03 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:56.685908 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-039afe49-3a1c-4fe3-af68-576667b7fa03 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:56.687930 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-039afe49-3a1c-4fe3-af68-576667b7fa03 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:56.688549 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-039afe49-3a1c-4fe3-af68-576667b7fa03 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:56.895830 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-039afe49-3a1c-4fe3-af68-576667b7fa03 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:56.907527 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-039afe49-3a1c-4fe3-af68-576667b7fa03 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:56.912572 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-039afe49-3a1c-4fe3-af68-576667b7fa03 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:56.913856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-039afe49-3a1c-4fe3-af68-576667b7fa03 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.253897 Aug 05 07:22:56.914954 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 399/810] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:22:56 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:22:57.060456 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-661265cd-81a7-4b42-96a6-4a2805e86ad2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "POST /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431631 Aug 05 07:22:57.061515 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 412/811] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:22:56 2022] POST /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:22:57.941960 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2f62c02e-4792-4b0c-9d42-23a7c32afa48 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:57.943431 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2f62c02e-4792-4b0c-9d42-23a7c32afa48 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:57.954204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f62c02e-4792-4b0c-9d42-23a7c32afa48 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:57.955648 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f62c02e-4792-4b0c-9d42-23a7c32afa48 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:57.956379 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f62c02e-4792-4b0c-9d42-23a7c32afa48 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:57.957358 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f62c02e-4792-4b0c-9d42-23a7c32afa48 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:57.958627 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f62c02e-4792-4b0c-9d42-23a7c32afa48 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:57.959432 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f62c02e-4792-4b0c-9d42-23a7c32afa48 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:58.124288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2f62c02e-4792-4b0c-9d42-23a7c32afa48 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:58.137992 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2f62c02e-4792-4b0c-9d42-23a7c32afa48 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:58.140047 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2f62c02e-4792-4b0c-9d42-23a7c32afa48 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:58.141496 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2f62c02e-4792-4b0c-9d42-23a7c32afa48 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.203923 Aug 05 07:22:58.142282 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 400/812] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:22:57 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:22:59.167263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4bbcd535-06ce-489d-8e94-d7061a33b051 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:22:59.168603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4bbcd535-06ce-489d-8e94-d7061a33b051 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:22:59.175568 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4bbcd535-06ce-489d-8e94-d7061a33b051 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:59.176049 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4bbcd535-06ce-489d-8e94-d7061a33b051 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:59.176471 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4bbcd535-06ce-489d-8e94-d7061a33b051 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:59.177423 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4bbcd535-06ce-489d-8e94-d7061a33b051 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:22:59.178086 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4bbcd535-06ce-489d-8e94-d7061a33b051 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:22:59.178503 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4bbcd535-06ce-489d-8e94-d7061a33b051 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:22:59.348566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4bbcd535-06ce-489d-8e94-d7061a33b051 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:59.384002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4bbcd535-06ce-489d-8e94-d7061a33b051 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:59.387916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4bbcd535-06ce-489d-8e94-d7061a33b051 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:22:59.389669 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4bbcd535-06ce-489d-8e94-d7061a33b051 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.227721 Aug 05 07:22:59.405445 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 413/813] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:22:59 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:00.429129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f296b78a-8fb1-4f8b-904a-80921795bf79 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:00.429129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f296b78a-8fb1-4f8b-904a-80921795bf79 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:00.471767 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f296b78a-8fb1-4f8b-904a-80921795bf79 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:00.472828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f296b78a-8fb1-4f8b-904a-80921795bf79 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:00.479649 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f296b78a-8fb1-4f8b-904a-80921795bf79 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:00.481390 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f296b78a-8fb1-4f8b-904a-80921795bf79 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:00.482459 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f296b78a-8fb1-4f8b-904a-80921795bf79 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:00.483494 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f296b78a-8fb1-4f8b-904a-80921795bf79 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:00.692494 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f296b78a-8fb1-4f8b-904a-80921795bf79 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:00.704366 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f296b78a-8fb1-4f8b-904a-80921795bf79 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:00.706517 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f296b78a-8fb1-4f8b-904a-80921795bf79 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:00.708057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f296b78a-8fb1-4f8b-904a-80921795bf79 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.294243 Aug 05 07:23:00.723293 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 401/814] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:00 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:01.732430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-012f6c52-51b4-4965-9a06-f39cc8d6b646 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:01.733341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-012f6c52-51b4-4965-9a06-f39cc8d6b646 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:01.740402 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-012f6c52-51b4-4965-9a06-f39cc8d6b646 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:01.741336 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-012f6c52-51b4-4965-9a06-f39cc8d6b646 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:01.742000 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-012f6c52-51b4-4965-9a06-f39cc8d6b646 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:01.742824 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-012f6c52-51b4-4965-9a06-f39cc8d6b646 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:01.743496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-012f6c52-51b4-4965-9a06-f39cc8d6b646 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:01.744083 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-012f6c52-51b4-4965-9a06-f39cc8d6b646 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:01.932964 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-012f6c52-51b4-4965-9a06-f39cc8d6b646 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:01.943166 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-012f6c52-51b4-4965-9a06-f39cc8d6b646 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:01.945146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-012f6c52-51b4-4965-9a06-f39cc8d6b646 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:01.946700 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-012f6c52-51b4-4965-9a06-f39cc8d6b646 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.218303 Aug 05 07:23:01.947819 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 414/815] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:01 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:02.970890 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d932f9a0-781e-4033-82a1-dc43dff5953f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:02.971501 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d932f9a0-781e-4033-82a1-dc43dff5953f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:02.980199 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d932f9a0-781e-4033-82a1-dc43dff5953f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:02.981034 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d932f9a0-781e-4033-82a1-dc43dff5953f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:02.981749 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d932f9a0-781e-4033-82a1-dc43dff5953f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:02.982682 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d932f9a0-781e-4033-82a1-dc43dff5953f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:02.983305 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d932f9a0-781e-4033-82a1-dc43dff5953f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:02.984038 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d932f9a0-781e-4033-82a1-dc43dff5953f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:03.140513 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d932f9a0-781e-4033-82a1-dc43dff5953f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:03.149553 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d932f9a0-781e-4033-82a1-dc43dff5953f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:03.151153 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d932f9a0-781e-4033-82a1-dc43dff5953f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:03.152336 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d932f9a0-781e-4033-82a1-dc43dff5953f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.185759 Aug 05 07:23:03.153123 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 402/816] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:02 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:04.178782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2ea01d07-f486-414f-a378-5b5c42ff12c5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:04.179562 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2ea01d07-f486-414f-a378-5b5c42ff12c5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:04.191282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2ea01d07-f486-414f-a378-5b5c42ff12c5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:04.191716 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2ea01d07-f486-414f-a378-5b5c42ff12c5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:04.192139 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2ea01d07-f486-414f-a378-5b5c42ff12c5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:04.193517 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2ea01d07-f486-414f-a378-5b5c42ff12c5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:04.194199 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2ea01d07-f486-414f-a378-5b5c42ff12c5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:04.194888 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2ea01d07-f486-414f-a378-5b5c42ff12c5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:04.465995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2ea01d07-f486-414f-a378-5b5c42ff12c5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:04.477821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2ea01d07-f486-414f-a378-5b5c42ff12c5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:04.485430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2ea01d07-f486-414f-a378-5b5c42ff12c5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:04.487453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2ea01d07-f486-414f-a378-5b5c42ff12c5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.314223 Aug 05 07:23:04.488682 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 415/817] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:04 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:04.818030 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1282be50-23ea-4d8f-bbdd-28ec50140123 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:04.820249 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1282be50-23ea-4d8f-bbdd-28ec50140123 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:04.827496 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1282be50-23ea-4d8f-bbdd-28ec50140123 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:04.828270 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1282be50-23ea-4d8f-bbdd-28ec50140123 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:04.828849 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1282be50-23ea-4d8f-bbdd-28ec50140123 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:04.829850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1282be50-23ea-4d8f-bbdd-28ec50140123 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:04.830446 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1282be50-23ea-4d8f-bbdd-28ec50140123 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:04.831168 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1282be50-23ea-4d8f-bbdd-28ec50140123 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:04.868305 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1282be50-23ea-4d8f-bbdd-28ec50140123 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056102 Aug 05 07:23:04.869228 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 403/818] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:23:04 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:04.880503 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-54989c35-2c09-4229-a589-ec671b5e400d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:04.881018 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-54989c35-2c09-4229-a589-ec671b5e400d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:04.888108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-54989c35-2c09-4229-a589-ec671b5e400d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:04.888597 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-54989c35-2c09-4229-a589-ec671b5e400d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:04.889061 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-54989c35-2c09-4229-a589-ec671b5e400d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:04.889770 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-54989c35-2c09-4229-a589-ec671b5e400d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:04.890441 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-54989c35-2c09-4229-a589-ec671b5e400d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:04.891048 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-54989c35-2c09-4229-a589-ec671b5e400d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:04.929408 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-54989c35-2c09-4229-a589-ec671b5e400d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments/fd8bca92-3856-4246-bdca-99fdad021080" status: 200 len: 194 microversion: 2.1 time: 0.052832 Aug 05 07:23:04.935364 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 416/819] 10.222.0.27 () {58 vars in 1413 bytes} [Fri Aug 5 07:23:04 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments/fd8bca92-3856-4246-bdca-99fdad021080 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:05.515559 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4a4e2a42-3433-4f07-a1a6-b5b83e13bfcd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:05.516383 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4a4e2a42-3433-4f07-a1a6-b5b83e13bfcd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:05.530098 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a4e2a42-3433-4f07-a1a6-b5b83e13bfcd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:05.530959 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a4e2a42-3433-4f07-a1a6-b5b83e13bfcd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:05.531559 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a4e2a42-3433-4f07-a1a6-b5b83e13bfcd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:05.532440 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a4e2a42-3433-4f07-a1a6-b5b83e13bfcd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:05.533078 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a4e2a42-3433-4f07-a1a6-b5b83e13bfcd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:05.533650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a4e2a42-3433-4f07-a1a6-b5b83e13bfcd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:05.733721 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4a4e2a42-3433-4f07-a1a6-b5b83e13bfcd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:05.743566 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4a4e2a42-3433-4f07-a1a6-b5b83e13bfcd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:05.745037 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4a4e2a42-3433-4f07-a1a6-b5b83e13bfcd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:05.746307 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4a4e2a42-3433-4f07-a1a6-b5b83e13bfcd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.235582 Aug 05 07:23:05.752004 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 404/820] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:05 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:05.863409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-03d70382-2856-4e96-8b60-703e0c15600c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Action: 'create', calling method: .version_select at 0x7f4963e67a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-518268991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLK2PCfeLvt4lskonXQ7Hwnxz3DGeFKKNaKepg3vHPFUS7nDAylYZxTvGENa4PUyUu570xQ8phXIAPyzOfFT9CGH+LerPcG/8L4HAbLYUrqjkDP4FAi2Sp7K/gmV3EmagA=="}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:05.882199 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-03d70382-2856-4e96-8b60-703e0c15600c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Getting quotas for project 1d6a92e28cc44d6b9abe831fb219eea0. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:23:05.887309 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-03d70382-2856-4e96-8b60-703e0c15600c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Getting quotas for user e383fda8f4ce4ddc841552c751f1a7bf and project 1d6a92e28cc44d6b9abe831fb219eea0. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:23:05.913201 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-03d70382-2856-4e96-8b60-703e0c15600c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053697 Aug 05 07:23:05.913939 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 417/821] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 5 07:23:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:05.968164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-290802342", "imageRef": "058ac95b-ee99-4b7f-9055-ed390867c8f6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-518268991", "networks": [{"uuid": "30e8a489-c65e-4afc-8bfc-b7ac332866c0"}]}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:06.023786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] validate_networks() for [('30e8a489-c65e-4afc-8bfc-b7ac332866c0', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:23:06.475509 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-65211d0f-642c-4a8f-8e13-a8d5be3b9310 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07e44524-7be0-4053-ae8b-e0f28342f5b7"}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:06.477889 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-65211d0f-642c-4a8f-8e13-a8d5be3b9310 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:06.485705 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-65211d0f-642c-4a8f-8e13-a8d5be3b9310 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:06.486160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-65211d0f-642c-4a8f-8e13-a8d5be3b9310 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:06.486582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-65211d0f-642c-4a8f-8e13-a8d5be3b9310 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:06.487298 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-65211d0f-642c-4a8f-8e13-a8d5be3b9310 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:06.487748 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-65211d0f-642c-4a8f-8e13-a8d5be3b9310 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:06.488167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-65211d0f-642c-4a8f-8e13-a8d5be3b9310 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:06.578580 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:23:06.579348 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:23:06.580206 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:23:06.580889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:23:06.581677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:23:06.597110 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:06.597983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:06.598831 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:06.600210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:06.601082 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:06.601865 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:06.631709 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Getting quotas for project 1d6a92e28cc44d6b9abe831fb219eea0. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:23:06.639066 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Getting quotas for user e383fda8f4ce4ddc841552c751f1a7bf and project 1d6a92e28cc44d6b9abe831fb219eea0. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:23:06.658165 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:23:06.662511 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='058ac95b-ee99-4b7f-9055-ed390867c8f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:23:06.711876 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5ad8e81c-d3bc-40f7-909c-f534688248cf tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747452 Aug 05 07:23:06.720155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 405/822] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:23:06.733676 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6ea3b27b-4900-48fc-b163-ead3e099d28b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:06.739194 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6ea3b27b-4900-48fc-b163-ead3e099d28b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:06.837938 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6ea3b27b-4900-48fc-b163-ead3e099d28b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:06.849743 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6ea3b27b-4900-48fc-b163-ead3e099d28b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1257 microversion: 2.1 time: 0.125825 Aug 05 07:23:06.850336 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 406/823] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:06 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1257 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:06.861415 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-57fe0de0-7f81-40ae-9759-a9f6b6f57f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:06.862754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-57fe0de0-7f81-40ae-9759-a9f6b6f57f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:06.877890 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-57fe0de0-7f81-40ae-9759-a9f6b6f57f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:06.878936 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-57fe0de0-7f81-40ae-9759-a9f6b6f57f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:06.880046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-57fe0de0-7f81-40ae-9759-a9f6b6f57f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:06.884725 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-57fe0de0-7f81-40ae-9759-a9f6b6f57f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:06.885821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-57fe0de0-7f81-40ae-9759-a9f6b6f57f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:06.886867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-57fe0de0-7f81-40ae-9759-a9f6b6f57f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:07.009413 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-65211d0f-642c-4a8f-8e13-a8d5be3b9310 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "POST /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538045 Aug 05 07:23:07.011968 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 418/824] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:23:06 2022] POST /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:23:07.103623 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-57fe0de0-7f81-40ae-9759-a9f6b6f57f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:07.117240 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-57fe0de0-7f81-40ae-9759-a9f6b6f57f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:07.119187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-57fe0de0-7f81-40ae-9759-a9f6b6f57f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:07.120460 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-57fe0de0-7f81-40ae-9759-a9f6b6f57f35 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.269009 Aug 05 07:23:07.121246 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 407/825] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:06 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:07.884235 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0c4fd438-625d-44cf-81c2-76cd39577cc6 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:07.884937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0c4fd438-625d-44cf-81c2-76cd39577cc6 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:07.892331 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c4fd438-625d-44cf-81c2-76cd39577cc6 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:07.892813 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c4fd438-625d-44cf-81c2-76cd39577cc6 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:07.893277 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c4fd438-625d-44cf-81c2-76cd39577cc6 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:07.893973 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c4fd438-625d-44cf-81c2-76cd39577cc6 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:07.894414 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c4fd438-625d-44cf-81c2-76cd39577cc6 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:07.894815 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0c4fd438-625d-44cf-81c2-76cd39577cc6 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:07.960495 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0c4fd438-625d-44cf-81c2-76cd39577cc6 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:07.968547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0c4fd438-625d-44cf-81c2-76cd39577cc6 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1309 microversion: 2.1 time: 0.089347 Aug 05 07:23:07.969214 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 419/826] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:07 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:08.148133 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-79a831bd-aea6-4eb0-ad23-aa176547a5a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:08.149236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-79a831bd-aea6-4eb0-ad23-aa176547a5a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:08.159351 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-79a831bd-aea6-4eb0-ad23-aa176547a5a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:08.160275 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-79a831bd-aea6-4eb0-ad23-aa176547a5a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:08.160804 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-79a831bd-aea6-4eb0-ad23-aa176547a5a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:08.162164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-79a831bd-aea6-4eb0-ad23-aa176547a5a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:08.163008 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-79a831bd-aea6-4eb0-ad23-aa176547a5a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:08.164058 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-79a831bd-aea6-4eb0-ad23-aa176547a5a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:08.413782 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-79a831bd-aea6-4eb0-ad23-aa176547a5a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:08.423799 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-79a831bd-aea6-4eb0-ad23-aa176547a5a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:08.425414 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-79a831bd-aea6-4eb0-ad23-aa176547a5a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:08.427098 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-79a831bd-aea6-4eb0-ad23-aa176547a5a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.286687 Aug 05 07:23:08.427678 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 408/827] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:08 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:08.990142 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9b242e73-65d1-49be-b6c4-6c2ce804ae0c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:08.990947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9b242e73-65d1-49be-b6c4-6c2ce804ae0c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:09.003799 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9b242e73-65d1-49be-b6c4-6c2ce804ae0c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:09.005755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9b242e73-65d1-49be-b6c4-6c2ce804ae0c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:09.006552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9b242e73-65d1-49be-b6c4-6c2ce804ae0c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:09.007670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9b242e73-65d1-49be-b6c4-6c2ce804ae0c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:09.008386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9b242e73-65d1-49be-b6c4-6c2ce804ae0c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:09.009015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9b242e73-65d1-49be-b6c4-6c2ce804ae0c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:09.293782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9b242e73-65d1-49be-b6c4-6c2ce804ae0c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:09.307616 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9b242e73-65d1-49be-b6c4-6c2ce804ae0c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.321674 Aug 05 07:23:09.308222 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 420/828] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:08 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:09.451106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-43656425-c12c-4155-ad5b-0601352dbc41 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:09.451664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-43656425-c12c-4155-ad5b-0601352dbc41 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:09.458454 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-43656425-c12c-4155-ad5b-0601352dbc41 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:09.458942 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-43656425-c12c-4155-ad5b-0601352dbc41 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:09.459372 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-43656425-c12c-4155-ad5b-0601352dbc41 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:09.460063 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-43656425-c12c-4155-ad5b-0601352dbc41 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:09.460510 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-43656425-c12c-4155-ad5b-0601352dbc41 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:09.460960 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-43656425-c12c-4155-ad5b-0601352dbc41 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:09.615503 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-43656425-c12c-4155-ad5b-0601352dbc41 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:09.625423 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-43656425-c12c-4155-ad5b-0601352dbc41 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:09.627000 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-43656425-c12c-4155-ad5b-0601352dbc41 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:09.628332 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-43656425-c12c-4155-ad5b-0601352dbc41 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.181499 Aug 05 07:23:09.628922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 409/829] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:09 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:10.339078 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c6c8c667-971e-4cb3-806b-e4682fa786ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:10.339854 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c6c8c667-971e-4cb3-806b-e4682fa786ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:10.347829 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c6c8c667-971e-4cb3-806b-e4682fa786ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:10.348529 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c6c8c667-971e-4cb3-806b-e4682fa786ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:10.349165 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c6c8c667-971e-4cb3-806b-e4682fa786ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:10.350093 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c6c8c667-971e-4cb3-806b-e4682fa786ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:10.350595 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c6c8c667-971e-4cb3-806b-e4682fa786ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:10.351107 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c6c8c667-971e-4cb3-806b-e4682fa786ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:10.522474 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c6c8c667-971e-4cb3-806b-e4682fa786ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:10.532233 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c6c8c667-971e-4cb3-806b-e4682fa786ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.196808 Aug 05 07:23:10.533043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 421/830] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:10 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:10.659069 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2051e891-1313-4e9f-ba15-5ad953e6d2ef tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:10.660104 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2051e891-1313-4e9f-ba15-5ad953e6d2ef tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:10.668040 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2051e891-1313-4e9f-ba15-5ad953e6d2ef tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:10.668517 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2051e891-1313-4e9f-ba15-5ad953e6d2ef tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:10.668962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2051e891-1313-4e9f-ba15-5ad953e6d2ef tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:10.669688 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2051e891-1313-4e9f-ba15-5ad953e6d2ef tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:10.670126 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2051e891-1313-4e9f-ba15-5ad953e6d2ef tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:10.670642 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2051e891-1313-4e9f-ba15-5ad953e6d2ef tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:10.843190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2051e891-1313-4e9f-ba15-5ad953e6d2ef tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:10.851630 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2051e891-1313-4e9f-ba15-5ad953e6d2ef tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:10.853151 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2051e891-1313-4e9f-ba15-5ad953e6d2ef tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:10.854524 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2051e891-1313-4e9f-ba15-5ad953e6d2ef tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.200133 Aug 05 07:23:10.854909 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 410/831] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:10 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:11.556128 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-61780244-ea62-491a-a106-be5dcc51f17c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:11.557050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-61780244-ea62-491a-a106-be5dcc51f17c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:11.565012 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-61780244-ea62-491a-a106-be5dcc51f17c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:11.565631 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-61780244-ea62-491a-a106-be5dcc51f17c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:11.566331 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-61780244-ea62-491a-a106-be5dcc51f17c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:11.567461 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-61780244-ea62-491a-a106-be5dcc51f17c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:11.568956 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-61780244-ea62-491a-a106-be5dcc51f17c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:11.569522 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-61780244-ea62-491a-a106-be5dcc51f17c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:11.763550 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-61780244-ea62-491a-a106-be5dcc51f17c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:11.773289 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-61780244-ea62-491a-a106-be5dcc51f17c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.221431 Aug 05 07:23:11.773984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 422/832] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:11 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:11.877910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f89c8a11-31b6-40bb-9f39-7dfb8e3eba66 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:11.878716 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f89c8a11-31b6-40bb-9f39-7dfb8e3eba66 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:11.886269 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f89c8a11-31b6-40bb-9f39-7dfb8e3eba66 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:11.886849 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f89c8a11-31b6-40bb-9f39-7dfb8e3eba66 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:11.887500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f89c8a11-31b6-40bb-9f39-7dfb8e3eba66 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:11.888458 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f89c8a11-31b6-40bb-9f39-7dfb8e3eba66 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:11.889210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f89c8a11-31b6-40bb-9f39-7dfb8e3eba66 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:11.889643 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f89c8a11-31b6-40bb-9f39-7dfb8e3eba66 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:12.279254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f89c8a11-31b6-40bb-9f39-7dfb8e3eba66 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:12.293866 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f89c8a11-31b6-40bb-9f39-7dfb8e3eba66 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:12.297564 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f89c8a11-31b6-40bb-9f39-7dfb8e3eba66 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:12.300343 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f89c8a11-31b6-40bb-9f39-7dfb8e3eba66 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.426444 Aug 05 07:23:12.302073 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 411/833] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:11 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:12.801024 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9210f153-8bd6-4ae9-a9e3-4b7adf4ff078 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:12.801748 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9210f153-8bd6-4ae9-a9e3-4b7adf4ff078 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:12.809427 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9210f153-8bd6-4ae9-a9e3-4b7adf4ff078 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:12.810011 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9210f153-8bd6-4ae9-a9e3-4b7adf4ff078 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:12.810514 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9210f153-8bd6-4ae9-a9e3-4b7adf4ff078 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:12.811299 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9210f153-8bd6-4ae9-a9e3-4b7adf4ff078 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:12.811822 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9210f153-8bd6-4ae9-a9e3-4b7adf4ff078 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:12.812349 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9210f153-8bd6-4ae9-a9e3-4b7adf4ff078 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:12.829857 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:13.005378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9210f153-8bd6-4ae9-a9e3-4b7adf4ff078 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:13.014432 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9210f153-8bd6-4ae9-a9e3-4b7adf4ff078 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.217321 Aug 05 07:23:13.015026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 423/834] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:12 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:13.326529 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-56b90fa2-9751-4197-af68-1d9caae73737 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:13.327450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-56b90fa2-9751-4197-af68-1d9caae73737 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:13.336573 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56b90fa2-9751-4197-af68-1d9caae73737 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:13.336573 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56b90fa2-9751-4197-af68-1d9caae73737 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:13.336573 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56b90fa2-9751-4197-af68-1d9caae73737 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:13.336573 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56b90fa2-9751-4197-af68-1d9caae73737 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:13.337136 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56b90fa2-9751-4197-af68-1d9caae73737 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:13.337136 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56b90fa2-9751-4197-af68-1d9caae73737 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:13.527319 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-56b90fa2-9751-4197-af68-1d9caae73737 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:13.536859 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-56b90fa2-9751-4197-af68-1d9caae73737 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:13.542753 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-56b90fa2-9751-4197-af68-1d9caae73737 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:13.544010 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-56b90fa2-9751-4197-af68-1d9caae73737 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.222806 Aug 05 07:23:13.544534 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 412/835] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:13 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:14.036299 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-420fc85a-ce7e-4953-a3d2-be956a458377 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:14.037311 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-420fc85a-ce7e-4953-a3d2-be956a458377 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:14.044608 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-420fc85a-ce7e-4953-a3d2-be956a458377 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:14.057591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-420fc85a-ce7e-4953-a3d2-be956a458377 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:14.058066 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-420fc85a-ce7e-4953-a3d2-be956a458377 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:14.058833 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-420fc85a-ce7e-4953-a3d2-be956a458377 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:14.059538 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-420fc85a-ce7e-4953-a3d2-be956a458377 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:14.059892 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-420fc85a-ce7e-4953-a3d2-be956a458377 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:14.243649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-420fc85a-ce7e-4953-a3d2-be956a458377 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:14.258920 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-420fc85a-ce7e-4953-a3d2-be956a458377 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.225528 Aug 05 07:23:14.260295 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 424/836] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:14 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:14.568452 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-97f105a9-e4d2-4fb2-b133-087559674beb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:14.569130 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-97f105a9-e4d2-4fb2-b133-087559674beb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:14.576382 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97f105a9-e4d2-4fb2-b133-087559674beb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:14.576882 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97f105a9-e4d2-4fb2-b133-087559674beb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:14.577349 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97f105a9-e4d2-4fb2-b133-087559674beb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:14.578042 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97f105a9-e4d2-4fb2-b133-087559674beb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:14.578718 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97f105a9-e4d2-4fb2-b133-087559674beb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:14.579142 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97f105a9-e4d2-4fb2-b133-087559674beb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:14.749110 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-97f105a9-e4d2-4fb2-b133-087559674beb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:14.760316 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-97f105a9-e4d2-4fb2-b133-087559674beb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:14.762278 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-97f105a9-e4d2-4fb2-b133-087559674beb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:14.763498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-97f105a9-e4d2-4fb2-b133-087559674beb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.199053 Aug 05 07:23:14.764070 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 413/837] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:14 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:15.297447 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-95276c55-b4f5-400e-b6d7-814136e6d026 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:15.298537 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-95276c55-b4f5-400e-b6d7-814136e6d026 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:15.309589 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95276c55-b4f5-400e-b6d7-814136e6d026 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:15.310428 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95276c55-b4f5-400e-b6d7-814136e6d026 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:15.311338 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95276c55-b4f5-400e-b6d7-814136e6d026 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:15.312573 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95276c55-b4f5-400e-b6d7-814136e6d026 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:15.313504 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95276c55-b4f5-400e-b6d7-814136e6d026 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:15.314033 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95276c55-b4f5-400e-b6d7-814136e6d026 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:15.471319 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-95276c55-b4f5-400e-b6d7-814136e6d026 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:15.479693 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-95276c55-b4f5-400e-b6d7-814136e6d026 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.189605 Aug 05 07:23:15.480582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 425/838] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:15 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:15.788987 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-54f3e986-f4be-4b0a-b982-63c69c6db213 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:15.790081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-54f3e986-f4be-4b0a-b982-63c69c6db213 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:15.796852 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-54f3e986-f4be-4b0a-b982-63c69c6db213 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:15.797566 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-54f3e986-f4be-4b0a-b982-63c69c6db213 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:15.798005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-54f3e986-f4be-4b0a-b982-63c69c6db213 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:15.798725 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-54f3e986-f4be-4b0a-b982-63c69c6db213 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:15.799173 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-54f3e986-f4be-4b0a-b982-63c69c6db213 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:15.799587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-54f3e986-f4be-4b0a-b982-63c69c6db213 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:15.837285 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:16.036796 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-54f3e986-f4be-4b0a-b982-63c69c6db213 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:16.047171 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-54f3e986-f4be-4b0a-b982-63c69c6db213 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:16.048889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-54f3e986-f4be-4b0a-b982-63c69c6db213 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:16.050146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-54f3e986-f4be-4b0a-b982-63c69c6db213 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.265397 Aug 05 07:23:16.051029 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 414/839] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:15 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:23:16.497726 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=4 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:16.503015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b42ffe2a-996e-4397-9426-4a6af9ac8298 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:16.503625 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b42ffe2a-996e-4397-9426-4a6af9ac8298 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:16.511146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b42ffe2a-996e-4397-9426-4a6af9ac8298 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:16.511628 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b42ffe2a-996e-4397-9426-4a6af9ac8298 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:16.512055 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b42ffe2a-996e-4397-9426-4a6af9ac8298 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:16.512786 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b42ffe2a-996e-4397-9426-4a6af9ac8298 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:16.513536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b42ffe2a-996e-4397-9426-4a6af9ac8298 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:16.513962 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b42ffe2a-996e-4397-9426-4a6af9ac8298 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:16.697784 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b42ffe2a-996e-4397-9426-4a6af9ac8298 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:16.715215 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b42ffe2a-996e-4397-9426-4a6af9ac8298 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.217705 Aug 05 07:23:16.717277 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 426/840] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:16 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:17.076131 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a7925828-747d-4f4d-9eea-983c2bb60aa5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:17.077109 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a7925828-747d-4f4d-9eea-983c2bb60aa5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:17.079299 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:17.081080 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=8 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:17.088924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7925828-747d-4f4d-9eea-983c2bb60aa5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:17.089552 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7925828-747d-4f4d-9eea-983c2bb60aa5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:17.090036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7925828-747d-4f4d-9eea-983c2bb60aa5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:17.090806 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7925828-747d-4f4d-9eea-983c2bb60aa5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:17.091275 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7925828-747d-4f4d-9eea-983c2bb60aa5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:17.091733 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7925828-747d-4f4d-9eea-983c2bb60aa5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:17.301905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a7925828-747d-4f4d-9eea-983c2bb60aa5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:17.318740 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a7925828-747d-4f4d-9eea-983c2bb60aa5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:17.321234 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a7925828-747d-4f4d-9eea-983c2bb60aa5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:17.323914 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a7925828-747d-4f4d-9eea-983c2bb60aa5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.252249 Aug 05 07:23:17.341768 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 415/841] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:17 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:17.749639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3cacaa8d-0e21-4b85-9410-4b20a07277eb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:17.750672 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3cacaa8d-0e21-4b85-9410-4b20a07277eb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:17.758755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3cacaa8d-0e21-4b85-9410-4b20a07277eb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:17.759539 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3cacaa8d-0e21-4b85-9410-4b20a07277eb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:17.760066 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3cacaa8d-0e21-4b85-9410-4b20a07277eb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:17.761314 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3cacaa8d-0e21-4b85-9410-4b20a07277eb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:17.761846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3cacaa8d-0e21-4b85-9410-4b20a07277eb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:17.762325 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3cacaa8d-0e21-4b85-9410-4b20a07277eb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:17.950089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3cacaa8d-0e21-4b85-9410-4b20a07277eb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:17.958667 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3cacaa8d-0e21-4b85-9410-4b20a07277eb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.214607 Aug 05 07:23:17.959273 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 427/842] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:17 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:23:18.362784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-242a090e-6e54-45a4-afc4-62383d61e80f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:18.363774 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-242a090e-6e54-45a4-afc4-62383d61e80f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:18.371359 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-242a090e-6e54-45a4-afc4-62383d61e80f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:18.371899 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-242a090e-6e54-45a4-afc4-62383d61e80f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:18.372444 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-242a090e-6e54-45a4-afc4-62383d61e80f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:18.373221 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-242a090e-6e54-45a4-afc4-62383d61e80f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:18.373674 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-242a090e-6e54-45a4-afc4-62383d61e80f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:18.374109 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-242a090e-6e54-45a4-afc4-62383d61e80f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:18.534365 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-242a090e-6e54-45a4-afc4-62383d61e80f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:18.545638 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-242a090e-6e54-45a4-afc4-62383d61e80f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:18.547150 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-242a090e-6e54-45a4-afc4-62383d61e80f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:18.548344 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-242a090e-6e54-45a4-afc4-62383d61e80f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.189999 Aug 05 07:23:18.548887 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 416/843] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:18 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:18.980315 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-10fd952f-d970-4303-9484-e9397e678d6f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:18.981083 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-10fd952f-d970-4303-9484-e9397e678d6f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:18.988192 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10fd952f-d970-4303-9484-e9397e678d6f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:18.988670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10fd952f-d970-4303-9484-e9397e678d6f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:18.989144 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10fd952f-d970-4303-9484-e9397e678d6f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:18.989911 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10fd952f-d970-4303-9484-e9397e678d6f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:18.990370 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10fd952f-d970-4303-9484-e9397e678d6f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:18.990797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10fd952f-d970-4303-9484-e9397e678d6f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:19.137898 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-10fd952f-d970-4303-9484-e9397e678d6f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:19.145963 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-10fd952f-d970-4303-9484-e9397e678d6f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.169929 Aug 05 07:23:19.146555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 428/844] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:18 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:19.571770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2d65659a-4785-4214-868c-30e8c69cfcaf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:19.572425 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2d65659a-4785-4214-868c-30e8c69cfcaf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:19.579238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d65659a-4785-4214-868c-30e8c69cfcaf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:19.579704 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d65659a-4785-4214-868c-30e8c69cfcaf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:19.580125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d65659a-4785-4214-868c-30e8c69cfcaf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:19.580845 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d65659a-4785-4214-868c-30e8c69cfcaf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:19.581308 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d65659a-4785-4214-868c-30e8c69cfcaf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:19.581728 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d65659a-4785-4214-868c-30e8c69cfcaf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:19.728252 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2d65659a-4785-4214-868c-30e8c69cfcaf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:19.738265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2d65659a-4785-4214-868c-30e8c69cfcaf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:19.739885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2d65659a-4785-4214-868c-30e8c69cfcaf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:19.741266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2d65659a-4785-4214-868c-30e8c69cfcaf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.173507 Aug 05 07:23:19.741838 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 417/845] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:19 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:20.167289 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a173b8f0-0454-4afc-9b37-f490fa6e72ee tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:20.167872 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a173b8f0-0454-4afc-9b37-f490fa6e72ee tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:20.174561 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a173b8f0-0454-4afc-9b37-f490fa6e72ee tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:20.175036 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a173b8f0-0454-4afc-9b37-f490fa6e72ee tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:20.175459 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a173b8f0-0454-4afc-9b37-f490fa6e72ee tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:20.176152 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a173b8f0-0454-4afc-9b37-f490fa6e72ee tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:20.176592 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a173b8f0-0454-4afc-9b37-f490fa6e72ee tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:20.177074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a173b8f0-0454-4afc-9b37-f490fa6e72ee tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:20.318791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a173b8f0-0454-4afc-9b37-f490fa6e72ee tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:20.327201 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a173b8f0-0454-4afc-9b37-f490fa6e72ee tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.163736 Aug 05 07:23:20.327800 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 429/846] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:20 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:20.766907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2444f56c-ea4f-4813-8f44-ea82e4d59a94 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:20.767577 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2444f56c-ea4f-4813-8f44-ea82e4d59a94 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:20.774646 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2444f56c-ea4f-4813-8f44-ea82e4d59a94 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:20.775135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2444f56c-ea4f-4813-8f44-ea82e4d59a94 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:20.775572 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2444f56c-ea4f-4813-8f44-ea82e4d59a94 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:20.776288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2444f56c-ea4f-4813-8f44-ea82e4d59a94 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:20.776740 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2444f56c-ea4f-4813-8f44-ea82e4d59a94 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:20.777196 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2444f56c-ea4f-4813-8f44-ea82e4d59a94 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:20.921300 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2444f56c-ea4f-4813-8f44-ea82e4d59a94 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:20.932742 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2444f56c-ea4f-4813-8f44-ea82e4d59a94 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:20.936155 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2444f56c-ea4f-4813-8f44-ea82e4d59a94 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:20.938394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2444f56c-ea4f-4813-8f44-ea82e4d59a94 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.178048 Aug 05 07:23:20.939610 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 418/847] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:20 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:21.347799 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-848f6967-b78f-436c-a716-99a8e7e6c44f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:21.348410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-848f6967-b78f-436c-a716-99a8e7e6c44f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:21.355325 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-848f6967-b78f-436c-a716-99a8e7e6c44f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:21.355813 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-848f6967-b78f-436c-a716-99a8e7e6c44f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:21.356237 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-848f6967-b78f-436c-a716-99a8e7e6c44f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:21.356970 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-848f6967-b78f-436c-a716-99a8e7e6c44f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:21.357420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-848f6967-b78f-436c-a716-99a8e7e6c44f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:21.357926 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-848f6967-b78f-436c-a716-99a8e7e6c44f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:21.508010 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-848f6967-b78f-436c-a716-99a8e7e6c44f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:21.516201 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-848f6967-b78f-436c-a716-99a8e7e6c44f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.172295 Aug 05 07:23:21.516789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 430/848] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:21 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:21.789127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-0c2f3d60-4fcf-462e-8a9c-e70b7fdd0e00 req-be4e67b5-0b62-48a6-95fd-0af1fbe63a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f", "tag": "75147734-bff6-4247-ac9b-8d971477e25b"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:21.795798 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:21.802796 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0c2f3d60-4fcf-462e-8a9c-e70b7fdd0e00 req-be4e67b5-0b62-48a6-95fd-0af1fbe63a23 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:21.803276 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0c2f3d60-4fcf-462e-8a9c-e70b7fdd0e00 req-be4e67b5-0b62-48a6-95fd-0af1fbe63a23 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:21.803710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0c2f3d60-4fcf-462e-8a9c-e70b7fdd0e00 req-be4e67b5-0b62-48a6-95fd-0af1fbe63a23 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:21.816766 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-0c2f3d60-4fcf-462e-8a9c-e70b7fdd0e00 req-be4e67b5-0b62-48a6-95fd-0af1fbe63a23 service nova] Creating event network-changed:75147734-bff6-4247-ac9b-8d971477e25b for instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f on hv-cinder-85200 Aug 05 07:23:21.822022 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-0c2f3d60-4fcf-462e-8a9c-e70b7fdd0e00 req-be4e67b5-0b62-48a6-95fd-0af1fbe63a23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037529 Aug 05 07:23:21.823980 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 419/849] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:21.977955 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9c29a06e-0e9b-43d7-96ae-7cc73d6b2ae3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:21.978625 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9c29a06e-0e9b-43d7-96ae-7cc73d6b2ae3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:21.985587 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9c29a06e-0e9b-43d7-96ae-7cc73d6b2ae3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:21.986100 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9c29a06e-0e9b-43d7-96ae-7cc73d6b2ae3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:21.986529 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9c29a06e-0e9b-43d7-96ae-7cc73d6b2ae3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:21.987240 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9c29a06e-0e9b-43d7-96ae-7cc73d6b2ae3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:21.987751 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9c29a06e-0e9b-43d7-96ae-7cc73d6b2ae3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:21.988167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9c29a06e-0e9b-43d7-96ae-7cc73d6b2ae3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:22.129703 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9c29a06e-0e9b-43d7-96ae-7cc73d6b2ae3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:22.138710 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9c29a06e-0e9b-43d7-96ae-7cc73d6b2ae3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:22.140247 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9c29a06e-0e9b-43d7-96ae-7cc73d6b2ae3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:22.141469 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9c29a06e-0e9b-43d7-96ae-7cc73d6b2ae3 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.167643 Aug 05 07:23:22.142037 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 431/850] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:21 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:22.540179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8a5ab510-9298-4a5f-83da-93b027f9143a tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:22.540885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8a5ab510-9298-4a5f-83da-93b027f9143a tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:22.547600 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8a5ab510-9298-4a5f-83da-93b027f9143a tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:22.548214 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8a5ab510-9298-4a5f-83da-93b027f9143a tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:22.548644 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8a5ab510-9298-4a5f-83da-93b027f9143a tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:22.549472 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8a5ab510-9298-4a5f-83da-93b027f9143a tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:22.550162 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8a5ab510-9298-4a5f-83da-93b027f9143a tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:22.550723 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8a5ab510-9298-4a5f-83da-93b027f9143a tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:22.695003 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8a5ab510-9298-4a5f-83da-93b027f9143a tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:22.706934 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8a5ab510-9298-4a5f-83da-93b027f9143a tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.171320 Aug 05 07:23:22.707778 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 420/851] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:22 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:23.190979 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-82885e19-044c-4ccb-a641-02f7a16ef46d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:23.191889 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-82885e19-044c-4ccb-a641-02f7a16ef46d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:23.202490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-82885e19-044c-4ccb-a641-02f7a16ef46d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:23.203110 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-82885e19-044c-4ccb-a641-02f7a16ef46d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:23.203616 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-82885e19-044c-4ccb-a641-02f7a16ef46d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:23.204544 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-82885e19-044c-4ccb-a641-02f7a16ef46d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:23.205151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-82885e19-044c-4ccb-a641-02f7a16ef46d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:23.205673 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-82885e19-044c-4ccb-a641-02f7a16ef46d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:23.275094 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f45ddb0e-5000-4134-bb98-a1858a0b1d57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:23.279410 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f45ddb0e-5000-4134-bb98-a1858a0b1d57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:23.290762 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f45ddb0e-5000-4134-bb98-a1858a0b1d57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:23.291615 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f45ddb0e-5000-4134-bb98-a1858a0b1d57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:23.292851 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f45ddb0e-5000-4134-bb98-a1858a0b1d57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:23.293848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f45ddb0e-5000-4134-bb98-a1858a0b1d57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:23.294774 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f45ddb0e-5000-4134-bb98-a1858a0b1d57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:23.295556 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f45ddb0e-5000-4134-bb98-a1858a0b1d57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:23.354828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f45ddb0e-5000-4134-bb98-a1858a0b1d57 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.087333 Aug 05 07:23:23.356171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-82885e19-044c-4ccb-a641-02f7a16ef46d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:23.356941 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 421/852] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:23:23 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:23.366511 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-82885e19-044c-4ccb-a641-02f7a16ef46d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:23.368147 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-82885e19-044c-4ccb-a641-02f7a16ef46d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:23.369583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-82885e19-044c-4ccb-a641-02f7a16ef46d tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1744 microversion: 2.20 time: 0.193790 Aug 05 07:23:23.370176 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 432/853] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:23 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:23.511560 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-85c99230-4ae8-454a-b9e1-01f6fea60306 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:23.513547 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-85c99230-4ae8-454a-b9e1-01f6fea60306 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:23.520941 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85c99230-4ae8-454a-b9e1-01f6fea60306 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:23.521524 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85c99230-4ae8-454a-b9e1-01f6fea60306 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:23.522028 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85c99230-4ae8-454a-b9e1-01f6fea60306 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:23.523033 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85c99230-4ae8-454a-b9e1-01f6fea60306 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:23.523602 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85c99230-4ae8-454a-b9e1-01f6fea60306 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:23.524095 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85c99230-4ae8-454a-b9e1-01f6fea60306 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:23.559784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-85c99230-4ae8-454a-b9e1-01f6fea60306 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments/fd8bca92-3856-4246-bdca-99fdad021080" status: 200 len: 194 microversion: 2.1 time: 0.063904 Aug 05 07:23:23.560873 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 422/854] 10.222.0.27 () {58 vars in 1413 bytes} [Fri Aug 5 07:23:23 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments/fd8bca92-3856-4246-bdca-99fdad021080 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:23.571540 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4a86a80a-57f9-47d8-82f8-01d1c67cf6ca tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:23.572042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4a86a80a-57f9-47d8-82f8-01d1c67cf6ca tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:23.578526 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4a86a80a-57f9-47d8-82f8-01d1c67cf6ca tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:23.579475 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4a86a80a-57f9-47d8-82f8-01d1c67cf6ca tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:23.580107 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4a86a80a-57f9-47d8-82f8-01d1c67cf6ca tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:23.581029 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4a86a80a-57f9-47d8-82f8-01d1c67cf6ca tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:23.581666 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4a86a80a-57f9-47d8-82f8-01d1c67cf6ca tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:23.582268 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4a86a80a-57f9-47d8-82f8-01d1c67cf6ca tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:23.671462 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-4a86a80a-57f9-47d8-82f8-01d1c67cf6ca tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lazy-loading 'services' on Instance uuid 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:23:23.728563 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-519cb1cb-f2ff-43ed-8fae-b90d29ea1314 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:23.729564 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-519cb1cb-f2ff-43ed-8fae-b90d29ea1314 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:23.736447 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-519cb1cb-f2ff-43ed-8fae-b90d29ea1314 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:23.737069 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-519cb1cb-f2ff-43ed-8fae-b90d29ea1314 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:23.737557 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-519cb1cb-f2ff-43ed-8fae-b90d29ea1314 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:23.738316 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-519cb1cb-f2ff-43ed-8fae-b90d29ea1314 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:23.739013 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-519cb1cb-f2ff-43ed-8fae-b90d29ea1314 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:23.739788 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-519cb1cb-f2ff-43ed-8fae-b90d29ea1314 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:23.755564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4a86a80a-57f9-47d8-82f8-01d1c67cf6ca tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments/fd8bca92-3856-4246-bdca-99fdad021080" status: 202 len: 0 microversion: 2.1 time: 0.187524 Aug 05 07:23:23.756503 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 433/855] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 5 07:23:23 2022] DELETE /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments/fd8bca92-3856-4246-bdca-99fdad021080 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:23:23.914947 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-519cb1cb-f2ff-43ed-8fae-b90d29ea1314 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:23.928570 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-519cb1cb-f2ff-43ed-8fae-b90d29ea1314 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.204170 Aug 05 07:23:23.929850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 423/856] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:23 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:23:24.410315 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-be8ebfba-766c-42db-bc10-ceaad53ddeaa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:24.411187 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-be8ebfba-766c-42db-bc10-ceaad53ddeaa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:24.415301 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:24.424732 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be8ebfba-766c-42db-bc10-ceaad53ddeaa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:24.425801 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be8ebfba-766c-42db-bc10-ceaad53ddeaa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:24.426388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be8ebfba-766c-42db-bc10-ceaad53ddeaa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:24.427202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be8ebfba-766c-42db-bc10-ceaad53ddeaa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:24.427659 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be8ebfba-766c-42db-bc10-ceaad53ddeaa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:24.428128 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-be8ebfba-766c-42db-bc10-ceaad53ddeaa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:24.595493 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-be8ebfba-766c-42db-bc10-ceaad53ddeaa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:24.604442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-be8ebfba-766c-42db-bc10-ceaad53ddeaa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:24.606011 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-be8ebfba-766c-42db-bc10-ceaad53ddeaa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:24.607246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-be8ebfba-766c-42db-bc10-ceaad53ddeaa tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1744 microversion: 2.20 time: 0.201584 Aug 05 07:23:24.607859 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 434/857] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:24 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1744 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:24.950232 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c341682f-24be-413c-9b66-025696fa446f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:24.950819 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c341682f-24be-413c-9b66-025696fa446f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:24.958337 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c341682f-24be-413c-9b66-025696fa446f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:24.958812 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c341682f-24be-413c-9b66-025696fa446f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:24.959242 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c341682f-24be-413c-9b66-025696fa446f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:24.959955 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c341682f-24be-413c-9b66-025696fa446f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:24.960404 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c341682f-24be-413c-9b66-025696fa446f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:24.960869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c341682f-24be-413c-9b66-025696fa446f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:25.097677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c341682f-24be-413c-9b66-025696fa446f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:25.110899 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c341682f-24be-413c-9b66-025696fa446f tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.164474 Aug 05 07:23:25.111413 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 424/858] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:24 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:25.631678 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-685b0146-b94a-454e-a8fd-d53a5c278aea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:25.632421 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-685b0146-b94a-454e-a8fd-d53a5c278aea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:25.639929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-685b0146-b94a-454e-a8fd-d53a5c278aea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:25.640419 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-685b0146-b94a-454e-a8fd-d53a5c278aea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:25.640855 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-685b0146-b94a-454e-a8fd-d53a5c278aea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:25.641719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-685b0146-b94a-454e-a8fd-d53a5c278aea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:25.642174 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-685b0146-b94a-454e-a8fd-d53a5c278aea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:25.642580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-685b0146-b94a-454e-a8fd-d53a5c278aea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:25.779417 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-685b0146-b94a-454e-a8fd-d53a5c278aea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:25.788585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-685b0146-b94a-454e-a8fd-d53a5c278aea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:25.790174 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-685b0146-b94a-454e-a8fd-d53a5c278aea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:25.791351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-685b0146-b94a-454e-a8fd-d53a5c278aea tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1744 microversion: 2.20 time: 0.164777 Aug 05 07:23:25.791924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 435/859] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:25 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:26.000237 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-12a79e1e-f9d4-4823-a59b-f02a4f688f94 req-f9f316a6-a7cd-4e75-9c6a-bc7ef9a6e82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d197c94-dfa3-4fe2-974d-4134fb0cb595", "name": "network-vif-plugged", "status": "completed", "tag": "155ed77d-f493-45be-ad25-67f9052f1659"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:26.012741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-12a79e1e-f9d4-4823-a59b-f02a4f688f94 req-f9f316a6-a7cd-4e75-9c6a-bc7ef9a6e82f service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:26.013315 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-12a79e1e-f9d4-4823-a59b-f02a4f688f94 req-f9f316a6-a7cd-4e75-9c6a-bc7ef9a6e82f service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:26.013746 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-12a79e1e-f9d4-4823-a59b-f02a4f688f94 req-f9f316a6-a7cd-4e75-9c6a-bc7ef9a6e82f service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:26.030502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-12a79e1e-f9d4-4823-a59b-f02a4f688f94 req-f9f316a6-a7cd-4e75-9c6a-bc7ef9a6e82f service nova] Creating event network-vif-plugged:155ed77d-f493-45be-ad25-67f9052f1659 for instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 on hv-cinder-85200 Aug 05 07:23:26.035822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-12a79e1e-f9d4-4823-a59b-f02a4f688f94 req-f9f316a6-a7cd-4e75-9c6a-bc7ef9a6e82f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039337 Aug 05 07:23:26.036642 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 425/860] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:26.133986 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-330b81d7-f2e0-44b3-acd9-5205f9233ced tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:26.134600 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-330b81d7-f2e0-44b3-acd9-5205f9233ced tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:26.141629 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-330b81d7-f2e0-44b3-acd9-5205f9233ced tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:26.142109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-330b81d7-f2e0-44b3-acd9-5205f9233ced tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:26.142535 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-330b81d7-f2e0-44b3-acd9-5205f9233ced tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:26.143229 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-330b81d7-f2e0-44b3-acd9-5205f9233ced tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:26.143674 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-330b81d7-f2e0-44b3-acd9-5205f9233ced tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:26.144089 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-330b81d7-f2e0-44b3-acd9-5205f9233ced tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:26.282144 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-330b81d7-f2e0-44b3-acd9-5205f9233ced tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:26.290254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-330b81d7-f2e0-44b3-acd9-5205f9233ced tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.160388 Aug 05 07:23:26.290823 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 436/861] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:26 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:23:26.816761 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1f57990a-ba17-4b4c-8d66-a5556155309f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:26.817510 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1f57990a-ba17-4b4c-8d66-a5556155309f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:26.824597 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1f57990a-ba17-4b4c-8d66-a5556155309f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:26.824852 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1f57990a-ba17-4b4c-8d66-a5556155309f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:26.825352 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1f57990a-ba17-4b4c-8d66-a5556155309f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:26.826033 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1f57990a-ba17-4b4c-8d66-a5556155309f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:26.826511 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1f57990a-ba17-4b4c-8d66-a5556155309f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:26.826928 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1f57990a-ba17-4b4c-8d66-a5556155309f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:26.973476 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1f57990a-ba17-4b4c-8d66-a5556155309f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:26.981450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1f57990a-ba17-4b4c-8d66-a5556155309f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:26.982952 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1f57990a-ba17-4b4c-8d66-a5556155309f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:26.984113 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1f57990a-ba17-4b4c-8d66-a5556155309f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1744 microversion: 2.20 time: 0.171995 Aug 05 07:23:26.984682 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 426/862] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:26 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:27.311756 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-32297bad-04ea-4790-b00c-f03378173355 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:27.312394 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-32297bad-04ea-4790-b00c-f03378173355 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:27.319782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-32297bad-04ea-4790-b00c-f03378173355 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:27.320273 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-32297bad-04ea-4790-b00c-f03378173355 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:27.320711 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-32297bad-04ea-4790-b00c-f03378173355 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:27.321476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-32297bad-04ea-4790-b00c-f03378173355 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:27.321929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-32297bad-04ea-4790-b00c-f03378173355 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:27.322351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-32297bad-04ea-4790-b00c-f03378173355 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:27.464133 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-32297bad-04ea-4790-b00c-f03378173355 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:27.472329 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-32297bad-04ea-4790-b00c-f03378173355 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.164402 Aug 05 07:23:27.472945 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 437/863] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:27 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:28.008010 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6b405a00-fb29-4882-a639-69610e46edb7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:28.008736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6b405a00-fb29-4882-a639-69610e46edb7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:28.016391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6b405a00-fb29-4882-a639-69610e46edb7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:28.016878 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6b405a00-fb29-4882-a639-69610e46edb7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:28.017423 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6b405a00-fb29-4882-a639-69610e46edb7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:28.018147 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6b405a00-fb29-4882-a639-69610e46edb7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:28.018590 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6b405a00-fb29-4882-a639-69610e46edb7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:28.019025 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6b405a00-fb29-4882-a639-69610e46edb7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:28.116999 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7b0fb3d3-edd2-4e52-befe-eb3a51858c8d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:28.117474 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7b0fb3d3-edd2-4e52-befe-eb3a51858c8d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:28.123914 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7b0fb3d3-edd2-4e52-befe-eb3a51858c8d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:28.124407 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7b0fb3d3-edd2-4e52-befe-eb3a51858c8d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:28.124843 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7b0fb3d3-edd2-4e52-befe-eb3a51858c8d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:28.125584 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7b0fb3d3-edd2-4e52-befe-eb3a51858c8d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:28.126042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7b0fb3d3-edd2-4e52-befe-eb3a51858c8d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:28.126679 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7b0fb3d3-edd2-4e52-befe-eb3a51858c8d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:28.160386 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6b405a00-fb29-4882-a639-69610e46edb7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:28.160806 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7b0fb3d3-edd2-4e52-befe-eb3a51858c8d tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments/07e44524-7be0-4053-ae8b-e0f28342f5b7" status: 200 len: 194 microversion: 2.1 time: 0.047936 Aug 05 07:23:28.161456 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 438/864] 10.222.0.27 () {58 vars in 1413 bytes} [Fri Aug 5 07:23:28 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments/07e44524-7be0-4053-ae8b-e0f28342f5b7 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:28.169060 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6b405a00-fb29-4882-a639-69610e46edb7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:28.170575 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6b405a00-fb29-4882-a639-69610e46edb7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:28.171780 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6b405a00-fb29-4882-a639-69610e46edb7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1744 microversion: 2.20 time: 0.168166 Aug 05 07:23:28.172027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-30c0117c-3e50-423a-bf99-1808d3131e7a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:28.172338 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 427/865] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:28 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:28.172523 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-30c0117c-3e50-423a-bf99-1808d3131e7a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:28.178909 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-30c0117c-3e50-423a-bf99-1808d3131e7a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:28.179392 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-30c0117c-3e50-423a-bf99-1808d3131e7a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:28.179818 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-30c0117c-3e50-423a-bf99-1808d3131e7a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:28.180507 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-30c0117c-3e50-423a-bf99-1808d3131e7a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:28.180993 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-30c0117c-3e50-423a-bf99-1808d3131e7a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:28.181406 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-30c0117c-3e50-423a-bf99-1808d3131e7a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:28.185471 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:28.268731 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-30c0117c-3e50-423a-bf99-1808d3131e7a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lazy-loading 'services' on Instance uuid 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:23:28.343609 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-30c0117c-3e50-423a-bf99-1808d3131e7a tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments/07e44524-7be0-4053-ae8b-e0f28342f5b7" status: 202 len: 0 microversion: 2.1 time: 0.175023 Aug 05 07:23:28.345133 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 439/866] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 5 07:23:28 2022] DELETE /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments/07e44524-7be0-4053-ae8b-e0f28342f5b7 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:23:28.493468 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4b36559e-5a90-435f-9cd0-62b75847fc04 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:28.494084 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4b36559e-5a90-435f-9cd0-62b75847fc04 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:28.500473 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b36559e-5a90-435f-9cd0-62b75847fc04 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:28.501016 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b36559e-5a90-435f-9cd0-62b75847fc04 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:28.501451 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b36559e-5a90-435f-9cd0-62b75847fc04 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:28.502164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b36559e-5a90-435f-9cd0-62b75847fc04 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:28.502641 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b36559e-5a90-435f-9cd0-62b75847fc04 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:28.503038 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b36559e-5a90-435f-9cd0-62b75847fc04 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:28.666625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4b36559e-5a90-435f-9cd0-62b75847fc04 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:28.674912 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4b36559e-5a90-435f-9cd0-62b75847fc04 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.185467 Aug 05 07:23:28.675494 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 428/867] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:28 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:29.195774 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-34825202-9c1a-4d88-a26a-31039e07dc7b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:29.196650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-34825202-9c1a-4d88-a26a-31039e07dc7b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:29.204663 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34825202-9c1a-4d88-a26a-31039e07dc7b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:29.206320 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34825202-9c1a-4d88-a26a-31039e07dc7b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:29.206320 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34825202-9c1a-4d88-a26a-31039e07dc7b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:29.207023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34825202-9c1a-4d88-a26a-31039e07dc7b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:29.207585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34825202-9c1a-4d88-a26a-31039e07dc7b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:29.208094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-34825202-9c1a-4d88-a26a-31039e07dc7b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:29.350082 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-34825202-9c1a-4d88-a26a-31039e07dc7b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:29.358770 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-34825202-9c1a-4d88-a26a-31039e07dc7b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:29.361291 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-34825202-9c1a-4d88-a26a-31039e07dc7b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:29.362509 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-34825202-9c1a-4d88-a26a-31039e07dc7b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1744 microversion: 2.20 time: 0.171340 Aug 05 07:23:29.363088 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 440/868] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:29 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:29.532230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-abf1ee78-2e8b-4cd0-b7cd-1b4a68c5aaf3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:29.534617 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-abf1ee78-2e8b-4cd0-b7cd-1b4a68c5aaf3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:29.541283 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-abf1ee78-2e8b-4cd0-b7cd-1b4a68c5aaf3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:29.541753 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-abf1ee78-2e8b-4cd0-b7cd-1b4a68c5aaf3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:29.542174 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-abf1ee78-2e8b-4cd0-b7cd-1b4a68c5aaf3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:29.542833 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-abf1ee78-2e8b-4cd0-b7cd-1b4a68c5aaf3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:29.543273 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-abf1ee78-2e8b-4cd0-b7cd-1b4a68c5aaf3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:29.543683 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-abf1ee78-2e8b-4cd0-b7cd-1b4a68c5aaf3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:29.573065 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-abf1ee78-2e8b-4cd0-b7cd-1b4a68c5aaf3 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044961 Aug 05 07:23:29.573638 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 429/869] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:23:29 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 07:23:29.695009 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-153e77e9-4b08-4f4b-9b90-c31dfd21722e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:29.697335 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-153e77e9-4b08-4f4b-9b90-c31dfd21722e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:29.697865 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9b4c1a38-3fc5-4b31-847f-7d699849fdd1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:29.698477 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9b4c1a38-3fc5-4b31-847f-7d699849fdd1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:29.703682 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-153e77e9-4b08-4f4b-9b90-c31dfd21722e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:29.704171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-153e77e9-4b08-4f4b-9b90-c31dfd21722e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:29.704465 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b4c1a38-3fc5-4b31-847f-7d699849fdd1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:29.704595 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-153e77e9-4b08-4f4b-9b90-c31dfd21722e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:29.704963 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b4c1a38-3fc5-4b31-847f-7d699849fdd1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:29.705419 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-153e77e9-4b08-4f4b-9b90-c31dfd21722e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:29.705544 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b4c1a38-3fc5-4b31-847f-7d699849fdd1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:29.705775 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-153e77e9-4b08-4f4b-9b90-c31dfd21722e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:29.706059 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b4c1a38-3fc5-4b31-847f-7d699849fdd1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:29.706166 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-153e77e9-4b08-4f4b-9b90-c31dfd21722e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:29.706493 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b4c1a38-3fc5-4b31-847f-7d699849fdd1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:29.706907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9b4c1a38-3fc5-4b31-847f-7d699849fdd1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:29.735826 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-153e77e9-4b08-4f4b-9b90-c31dfd21722e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044899 Aug 05 07:23:29.736416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 441/870] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:23:29 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 07:23:29.798080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8e1916c6-021b-45b8-94ac-55d3a0974186 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:29.798570 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8e1916c6-021b-45b8-94ac-55d3a0974186 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:29.804633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e1916c6-021b-45b8-94ac-55d3a0974186 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:29.805152 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e1916c6-021b-45b8-94ac-55d3a0974186 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:29.805579 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e1916c6-021b-45b8-94ac-55d3a0974186 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:29.806264 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e1916c6-021b-45b8-94ac-55d3a0974186 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:29.806695 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e1916c6-021b-45b8-94ac-55d3a0974186 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:29.807205 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e1916c6-021b-45b8-94ac-55d3a0974186 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:29.831963 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8e1916c6-021b-45b8-94ac-55d3a0974186 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Going to try to terminate instance {{(pid=117894) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:23:29.839022 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9b4c1a38-3fc5-4b31-847f-7d699849fdd1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:29.846636 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9b4c1a38-3fc5-4b31-847f-7d699849fdd1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.152690 Aug 05 07:23:29.847216 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 430/871] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:29 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:29.915417 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8e1916c6-021b-45b8-94ac-55d3a0974186 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 204 len: 0 microversion: 2.1 time: 0.120835 Aug 05 07:23:29.916115 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 442/872] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:23:29 2022] DELETE /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 07:23:29.924934 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c6e461cf-485a-4a1a-b2d3-ebca128cfca2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:29.925575 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c6e461cf-485a-4a1a-b2d3-ebca128cfca2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:29.932027 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c6e461cf-485a-4a1a-b2d3-ebca128cfca2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:29.932800 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c6e461cf-485a-4a1a-b2d3-ebca128cfca2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:29.933278 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c6e461cf-485a-4a1a-b2d3-ebca128cfca2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:29.933975 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c6e461cf-485a-4a1a-b2d3-ebca128cfca2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:29.934432 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c6e461cf-485a-4a1a-b2d3-ebca128cfca2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:29.934853 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c6e461cf-485a-4a1a-b2d3-ebca128cfca2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:30.080672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c6e461cf-485a-4a1a-b2d3-ebca128cfca2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:30.089506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c6e461cf-485a-4a1a-b2d3-ebca128cfca2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1673 microversion: 2.1 time: 0.168493 Aug 05 07:23:30.089956 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-4bd56a3f-e9d6-4e3c-a392-38162a743187 req-4e63d3b8-4222-47fd-898f-6242016f70ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f", "name": "network-vif-plugged", "status": "completed", "tag": "75147734-bff6-4247-ac9b-8d971477e25b"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:30.090382 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 431/873] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:29 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:30.099616 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-4bd56a3f-e9d6-4e3c-a392-38162a743187 req-4e63d3b8-4222-47fd-898f-6242016f70ee service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:30.100080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-4bd56a3f-e9d6-4e3c-a392-38162a743187 req-4e63d3b8-4222-47fd-898f-6242016f70ee service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:30.100520 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-4bd56a3f-e9d6-4e3c-a392-38162a743187 req-4e63d3b8-4222-47fd-898f-6242016f70ee service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:30.112506 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-4bd56a3f-e9d6-4e3c-a392-38162a743187 req-4e63d3b8-4222-47fd-898f-6242016f70ee service nova] Creating event network-vif-plugged:75147734-bff6-4247-ac9b-8d971477e25b for instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f on hv-cinder-85200 Aug 05 07:23:30.117396 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-4bd56a3f-e9d6-4e3c-a392-38162a743187 req-4e63d3b8-4222-47fd-898f-6242016f70ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031436 Aug 05 07:23:30.118202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 443/874] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:23:30.386623 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a0d6a194-23fd-4eac-a063-82e3b840c813 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:30.387258 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a0d6a194-23fd-4eac-a063-82e3b840c813 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:30.398845 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0d6a194-23fd-4eac-a063-82e3b840c813 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:30.399716 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0d6a194-23fd-4eac-a063-82e3b840c813 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:30.400487 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0d6a194-23fd-4eac-a063-82e3b840c813 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:30.401765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0d6a194-23fd-4eac-a063-82e3b840c813 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:30.402577 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0d6a194-23fd-4eac-a063-82e3b840c813 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:30.403273 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0d6a194-23fd-4eac-a063-82e3b840c813 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:30.427103 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:30.549469 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0d6a194-23fd-4eac-a063-82e3b840c813 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:30.557962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0d6a194-23fd-4eac-a063-82e3b840c813 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:30.559530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0d6a194-23fd-4eac-a063-82e3b840c813 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:30.560703 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a0d6a194-23fd-4eac-a063-82e3b840c813 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1744 microversion: 2.20 time: 0.178509 Aug 05 07:23:30.561309 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 432/875] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:30 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:30.868661 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6684cc6c-b15e-4b0c-b8a1-7500512b9f69 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:30.869511 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-6684cc6c-b15e-4b0c-b8a1-7500512b9f69 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:30.875866 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6684cc6c-b15e-4b0c-b8a1-7500512b9f69 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:30.876358 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6684cc6c-b15e-4b0c-b8a1-7500512b9f69 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:30.876795 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6684cc6c-b15e-4b0c-b8a1-7500512b9f69 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:30.877536 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6684cc6c-b15e-4b0c-b8a1-7500512b9f69 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:30.877990 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6684cc6c-b15e-4b0c-b8a1-7500512b9f69 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:30.878409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6684cc6c-b15e-4b0c-b8a1-7500512b9f69 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:31.019916 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-6684cc6c-b15e-4b0c-b8a1-7500512b9f69 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:31.028093 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-6684cc6c-b15e-4b0c-b8a1-7500512b9f69 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.164468 Aug 05 07:23:31.028671 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 444/876] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:30 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:31.113411 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-11a2d410-01e7-421b-ab28-84da5a2788af tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:31.114040 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-11a2d410-01e7-421b-ab28-84da5a2788af tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:31.121515 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11a2d410-01e7-421b-ab28-84da5a2788af tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:31.121932 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11a2d410-01e7-421b-ab28-84da5a2788af tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:31.122355 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11a2d410-01e7-421b-ab28-84da5a2788af tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:31.123073 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11a2d410-01e7-421b-ab28-84da5a2788af tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:31.123526 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11a2d410-01e7-421b-ab28-84da5a2788af tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:31.123948 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11a2d410-01e7-421b-ab28-84da5a2788af tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:31.260790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-11a2d410-01e7-421b-ab28-84da5a2788af tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:31.269251 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-11a2d410-01e7-421b-ab28-84da5a2788af tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1673 microversion: 2.1 time: 0.159776 Aug 05 07:23:31.269844 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 433/877] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:31 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:31.588098 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-05f9b83a-fb5b-4b80-8587-be6b475711cd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:31.588743 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-05f9b83a-fb5b-4b80-8587-be6b475711cd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:31.595171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-05f9b83a-fb5b-4b80-8587-be6b475711cd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:31.595801 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-05f9b83a-fb5b-4b80-8587-be6b475711cd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:31.596406 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-05f9b83a-fb5b-4b80-8587-be6b475711cd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:31.597305 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-05f9b83a-fb5b-4b80-8587-be6b475711cd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:31.597911 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-05f9b83a-fb5b-4b80-8587-be6b475711cd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:31.598486 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-05f9b83a-fb5b-4b80-8587-be6b475711cd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:31.747650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-05f9b83a-fb5b-4b80-8587-be6b475711cd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:31.756956 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-05f9b83a-fb5b-4b80-8587-be6b475711cd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:31.758583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-05f9b83a-fb5b-4b80-8587-be6b475711cd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:31.759853 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-05f9b83a-fb5b-4b80-8587-be6b475711cd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1739 microversion: 2.20 time: 0.180749 Aug 05 07:23:31.760837 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 445/878] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:31 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:32.049283 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-53d83015-6397-48e3-9076-7fef91aa44fc tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:32.049958 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-53d83015-6397-48e3-9076-7fef91aa44fc tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:32.057231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-53d83015-6397-48e3-9076-7fef91aa44fc tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:32.057731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-53d83015-6397-48e3-9076-7fef91aa44fc tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:32.058169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-53d83015-6397-48e3-9076-7fef91aa44fc tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:32.058875 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-53d83015-6397-48e3-9076-7fef91aa44fc tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:32.059329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-53d83015-6397-48e3-9076-7fef91aa44fc tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:32.059750 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-53d83015-6397-48e3-9076-7fef91aa44fc tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:32.298078 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ef116296-6a73-4af0-b51d-9beb130eb5ce tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:32.300790 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ef116296-6a73-4af0-b51d-9beb130eb5ce tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:32.314133 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef116296-6a73-4af0-b51d-9beb130eb5ce tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:32.315702 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef116296-6a73-4af0-b51d-9beb130eb5ce tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:32.316765 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef116296-6a73-4af0-b51d-9beb130eb5ce tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:32.317863 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef116296-6a73-4af0-b51d-9beb130eb5ce tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:32.319371 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef116296-6a73-4af0-b51d-9beb130eb5ce tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:32.320222 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ef116296-6a73-4af0-b51d-9beb130eb5ce tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:32.415213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-53d83015-6397-48e3-9076-7fef91aa44fc tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:32.427118 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-53d83015-6397-48e3-9076-7fef91aa44fc tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.381950 Aug 05 07:23:32.427734 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 434/879] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:32 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:32.557532 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ef116296-6a73-4af0-b51d-9beb130eb5ce tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:32.572555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ef116296-6a73-4af0-b51d-9beb130eb5ce tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1673 microversion: 2.1 time: 0.285712 Aug 05 07:23:32.573467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 446/880] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:32 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1673 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:32.788966 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-417bb1b9-94fd-4a2b-b513-316d70d078d1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:32.789601 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-417bb1b9-94fd-4a2b-b513-316d70d078d1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:32.814834 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-417bb1b9-94fd-4a2b-b513-316d70d078d1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:32.817861 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-417bb1b9-94fd-4a2b-b513-316d70d078d1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:32.818561 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-417bb1b9-94fd-4a2b-b513-316d70d078d1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:32.819872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-417bb1b9-94fd-4a2b-b513-316d70d078d1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:32.823197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-417bb1b9-94fd-4a2b-b513-316d70d078d1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:32.824557 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-417bb1b9-94fd-4a2b-b513-316d70d078d1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:33.084233 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-417bb1b9-94fd-4a2b-b513-316d70d078d1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:33.103724 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-417bb1b9-94fd-4a2b-b513-316d70d078d1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:33.106898 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-417bb1b9-94fd-4a2b-b513-316d70d078d1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:33.108674 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-417bb1b9-94fd-4a2b-b513-316d70d078d1 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1739 microversion: 2.20 time: 0.327078 Aug 05 07:23:33.109521 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 435/881] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:32 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1739 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:33.451373 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-91f846c9-c8b9-4fb2-a430-34c1beb781a7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:33.452021 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-91f846c9-c8b9-4fb2-a430-34c1beb781a7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:33.472718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91f846c9-c8b9-4fb2-a430-34c1beb781a7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:33.473256 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91f846c9-c8b9-4fb2-a430-34c1beb781a7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:33.473693 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91f846c9-c8b9-4fb2-a430-34c1beb781a7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:33.474431 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91f846c9-c8b9-4fb2-a430-34c1beb781a7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:33.474878 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91f846c9-c8b9-4fb2-a430-34c1beb781a7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:33.475357 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-91f846c9-c8b9-4fb2-a430-34c1beb781a7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:33.478574 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-6e9722f7-48f9-40c7-8695-f967d234b2ef req-79fad496-8458-45d9-800e-f9c4adc8a214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd3c1c0-4733-45dc-ab55-794aa3ea12e9", "name": "network-vif-deleted", "tag": "2fef8161-aaaa-4f88-9f08-285fe2c78aa5"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:33.526590 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-6e9722f7-48f9-40c7-8695-f967d234b2ef req-79fad496-8458-45d9-800e-f9c4adc8a214 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:33.547342 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-6e9722f7-48f9-40c7-8695-f967d234b2ef req-79fad496-8458-45d9-800e-f9c4adc8a214 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:33.548522 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-6e9722f7-48f9-40c7-8695-f967d234b2ef req-79fad496-8458-45d9-800e-f9c4adc8a214 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:33.565532 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-6e9722f7-48f9-40c7-8695-f967d234b2ef req-79fad496-8458-45d9-800e-f9c4adc8a214 service nova] Creating event network-vif-deleted:2fef8161-aaaa-4f88-9f08-285fe2c78aa5 for instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 on hv-cinder-85200 Aug 05 07:23:33.574231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-6e9722f7-48f9-40c7-8695-f967d234b2ef req-79fad496-8458-45d9-800e-f9c4adc8a214 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102416 Aug 05 07:23:33.575592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 436/882] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:33.612605 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-923701a9-9042-4a81-889e-6f82804144cc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:33.617768 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-923701a9-9042-4a81-889e-6f82804144cc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:33.632186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-923701a9-9042-4a81-889e-6f82804144cc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:33.633680 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-923701a9-9042-4a81-889e-6f82804144cc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:33.634364 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-923701a9-9042-4a81-889e-6f82804144cc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:33.637895 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-923701a9-9042-4a81-889e-6f82804144cc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:33.639231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-923701a9-9042-4a81-889e-6f82804144cc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:33.639892 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-923701a9-9042-4a81-889e-6f82804144cc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:33.706937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-91f846c9-c8b9-4fb2-a430-34c1beb781a7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:33.732390 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-91f846c9-c8b9-4fb2-a430-34c1beb781a7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.285056 Aug 05 07:23:33.733017 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 447/883] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:33 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:33.781198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-923701a9-9042-4a81-889e-6f82804144cc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:33.789287 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-923701a9-9042-4a81-889e-6f82804144cc tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1605 microversion: 2.1 time: 0.193599 Aug 05 07:23:33.792762 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 437/884] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:33 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1605 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:34.142274 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c354d5f0-8e8c-4816-822f-0c2d102959b8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:34.143462 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c354d5f0-8e8c-4816-822f-0c2d102959b8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:34.166804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c354d5f0-8e8c-4816-822f-0c2d102959b8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:34.167201 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c354d5f0-8e8c-4816-822f-0c2d102959b8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:34.167625 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c354d5f0-8e8c-4816-822f-0c2d102959b8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:34.168338 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c354d5f0-8e8c-4816-822f-0c2d102959b8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:34.168785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c354d5f0-8e8c-4816-822f-0c2d102959b8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:34.169336 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c354d5f0-8e8c-4816-822f-0c2d102959b8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:34.331240 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c354d5f0-8e8c-4816-822f-0c2d102959b8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:34.340420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c354d5f0-8e8c-4816-822f-0c2d102959b8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:34.342038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c354d5f0-8e8c-4816-822f-0c2d102959b8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:34.343969 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c354d5f0-8e8c-4816-822f-0c2d102959b8 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1739 microversion: 2.20 time: 0.213903 Aug 05 07:23:34.361824 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 448/885] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:34 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:34.768523 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ea82708f-4f43-4258-984f-cd2321d465cb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:34.770065 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ea82708f-4f43-4258-984f-cd2321d465cb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:34.785488 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ea82708f-4f43-4258-984f-cd2321d465cb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:34.785964 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ea82708f-4f43-4258-984f-cd2321d465cb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:34.786400 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ea82708f-4f43-4258-984f-cd2321d465cb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:34.787111 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ea82708f-4f43-4258-984f-cd2321d465cb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:34.787560 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ea82708f-4f43-4258-984f-cd2321d465cb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:34.788029 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ea82708f-4f43-4258-984f-cd2321d465cb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:34.812668 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-52cbe02c-c4fe-4a67-8e08-b6c118effa3f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:34.814007 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-52cbe02c-c4fe-4a67-8e08-b6c118effa3f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:34.832130 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52cbe02c-c4fe-4a67-8e08-b6c118effa3f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:34.833522 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52cbe02c-c4fe-4a67-8e08-b6c118effa3f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:34.834366 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52cbe02c-c4fe-4a67-8e08-b6c118effa3f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:34.839277 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52cbe02c-c4fe-4a67-8e08-b6c118effa3f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:34.839277 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52cbe02c-c4fe-4a67-8e08-b6c118effa3f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:34.839277 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52cbe02c-c4fe-4a67-8e08-b6c118effa3f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:34.952753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-52cbe02c-c4fe-4a67-8e08-b6c118effa3f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:34.967020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-52cbe02c-c4fe-4a67-8e08-b6c118effa3f tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1605 microversion: 2.1 time: 0.159672 Aug 05 07:23:34.983224 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 449/886] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:34 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1605 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:23:34.987939 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ea82708f-4f43-4258-984f-cd2321d465cb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:34.997326 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ea82708f-4f43-4258-984f-cd2321d465cb tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.232613 Aug 05 07:23:34.998145 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 438/887] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:34 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:35.384811 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-27a504d5-62d6-4a2a-abad-2d26975ff2b6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:35.385985 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-27a504d5-62d6-4a2a-abad-2d26975ff2b6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:35.393670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-27a504d5-62d6-4a2a-abad-2d26975ff2b6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:35.394580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-27a504d5-62d6-4a2a-abad-2d26975ff2b6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:35.394689 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-27a504d5-62d6-4a2a-abad-2d26975ff2b6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:35.395470 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-27a504d5-62d6-4a2a-abad-2d26975ff2b6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:35.396733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-27a504d5-62d6-4a2a-abad-2d26975ff2b6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:35.396733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-27a504d5-62d6-4a2a-abad-2d26975ff2b6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:35.564288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-27a504d5-62d6-4a2a-abad-2d26975ff2b6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:35.573066 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-27a504d5-62d6-4a2a-abad-2d26975ff2b6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:35.574567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-27a504d5-62d6-4a2a-abad-2d26975ff2b6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:35.575737 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-27a504d5-62d6-4a2a-abad-2d26975ff2b6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1739 microversion: 2.20 time: 0.194992 Aug 05 07:23:35.576311 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 450/888] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:35 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:35.990427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-840dcc9a-20e8-453c-8f1c-975d09adc3e4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:35.992433 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-840dcc9a-20e8-453c-8f1c-975d09adc3e4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:36.000057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-840dcc9a-20e8-453c-8f1c-975d09adc3e4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:36.000837 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-840dcc9a-20e8-453c-8f1c-975d09adc3e4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:36.002240 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-840dcc9a-20e8-453c-8f1c-975d09adc3e4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:36.003156 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-840dcc9a-20e8-453c-8f1c-975d09adc3e4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:36.004170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-840dcc9a-20e8-453c-8f1c-975d09adc3e4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:36.004170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-840dcc9a-20e8-453c-8f1c-975d09adc3e4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:36.019799 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e055c31f-b951-4544-a1b9-cb7dbf82b979 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:36.021630 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e055c31f-b951-4544-a1b9-cb7dbf82b979 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:36.033949 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e055c31f-b951-4544-a1b9-cb7dbf82b979 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:36.035157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e055c31f-b951-4544-a1b9-cb7dbf82b979 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:36.039202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e055c31f-b951-4544-a1b9-cb7dbf82b979 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:36.040387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e055c31f-b951-4544-a1b9-cb7dbf82b979 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:36.041106 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e055c31f-b951-4544-a1b9-cb7dbf82b979 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:36.042609 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e055c31f-b951-4544-a1b9-cb7dbf82b979 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:36.121905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-840dcc9a-20e8-453c-8f1c-975d09adc3e4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:36.141489 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-840dcc9a-20e8-453c-8f1c-975d09adc3e4 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1605 microversion: 2.1 time: 0.154811 Aug 05 07:23:36.142546 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 439/889] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:35 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1605 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:36.257751 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e055c31f-b951-4544-a1b9-cb7dbf82b979 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:36.268283 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e055c31f-b951-4544-a1b9-cb7dbf82b979 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.253313 Aug 05 07:23:36.280991 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 451/890] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:36 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:36.603490 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f0f4bf5a-7b77-4297-b161-2e20834533de tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:36.604972 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f0f4bf5a-7b77-4297-b161-2e20834533de tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:36.613531 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f0f4bf5a-7b77-4297-b161-2e20834533de tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:36.614532 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f0f4bf5a-7b77-4297-b161-2e20834533de tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:36.615034 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f0f4bf5a-7b77-4297-b161-2e20834533de tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:36.615954 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f0f4bf5a-7b77-4297-b161-2e20834533de tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:36.616643 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f0f4bf5a-7b77-4297-b161-2e20834533de tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:36.617213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f0f4bf5a-7b77-4297-b161-2e20834533de tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:36.795475 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f0f4bf5a-7b77-4297-b161-2e20834533de tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:36.802929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f0f4bf5a-7b77-4297-b161-2e20834533de tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:36.804922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f0f4bf5a-7b77-4297-b161-2e20834533de tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:36.806277 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f0f4bf5a-7b77-4297-b161-2e20834533de tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1739 microversion: 2.20 time: 0.209265 Aug 05 07:23:36.806871 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 440/891] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:36 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:37.178068 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:37.179269 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:37.191621 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:37.192499 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:37.193306 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:37.195221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:37.196249 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:37.197227 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:37.244846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:37.246550 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:37.247562 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:37.248546 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lazy-loading 'fault' on Instance uuid 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:23:37.292133 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b7f5db8b-3339-471d-9fd0-c46150416cf5 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:37.293544 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b7f5db8b-3339-471d-9fd0-c46150416cf5 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:37.306901 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b7f5db8b-3339-471d-9fd0-c46150416cf5 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:37.309390 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b7f5db8b-3339-471d-9fd0-c46150416cf5 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:37.311284 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b7f5db8b-3339-471d-9fd0-c46150416cf5 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:37.312179 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c685b300874351ab2dbd62bea1a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e23c5c336e486f995f88c12b72b2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:37.316967 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b7f5db8b-3339-471d-9fd0-c46150416cf5 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:37.317653 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b7f5db8b-3339-471d-9fd0-c46150416cf5 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:37.318967 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b7f5db8b-3339-471d-9fd0-c46150416cf5 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:37.320932 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1f2a27f1-6a28-41c7-a34a-b58d5bf91c4b tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 200 len: 1328 microversion: 2.1 time: 0.159959 Aug 05 07:23:37.322079 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 452/892] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:37 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 1328 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:37.556333 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b7f5db8b-3339-471d-9fd0-c46150416cf5 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:37.565910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b7f5db8b-3339-471d-9fd0-c46150416cf5 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1357 microversion: 2.1 time: 0.277565 Aug 05 07:23:37.570127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 441/893] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:37 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1357 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:37.830615 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-48466fc9-1f62-454d-90d9-d99e1372fd0a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:37.831503 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-48466fc9-1f62-454d-90d9-d99e1372fd0a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:37.838701 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48466fc9-1f62-454d-90d9-d99e1372fd0a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:37.839430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48466fc9-1f62-454d-90d9-d99e1372fd0a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:37.839952 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48466fc9-1f62-454d-90d9-d99e1372fd0a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:37.840736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48466fc9-1f62-454d-90d9-d99e1372fd0a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:37.841418 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48466fc9-1f62-454d-90d9-d99e1372fd0a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:37.841833 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48466fc9-1f62-454d-90d9-d99e1372fd0a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:37.976161 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-48466fc9-1f62-454d-90d9-d99e1372fd0a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:37.979906 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:37.986188 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-48466fc9-1f62-454d-90d9-d99e1372fd0a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:37.987688 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-48466fc9-1f62-454d-90d9-d99e1372fd0a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:37.989018 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-48466fc9-1f62-454d-90d9-d99e1372fd0a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1739 microversion: 2.20 time: 0.163030 Aug 05 07:23:37.989593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 453/894] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:37 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:38.342118 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6cf57d7b-3b2d-4d8a-a3eb-116ef41bae7e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:38.342905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6cf57d7b-3b2d-4d8a-a3eb-116ef41bae7e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:38.351900 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6cf57d7b-3b2d-4d8a-a3eb-116ef41bae7e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:38.352540 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6cf57d7b-3b2d-4d8a-a3eb-116ef41bae7e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:38.353106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6cf57d7b-3b2d-4d8a-a3eb-116ef41bae7e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:38.353894 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6cf57d7b-3b2d-4d8a-a3eb-116ef41bae7e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:38.354609 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6cf57d7b-3b2d-4d8a-a3eb-116ef41bae7e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:38.355145 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6cf57d7b-3b2d-4d8a-a3eb-116ef41bae7e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:38.372343 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-6cf57d7b-3b2d-4d8a-a3eb-116ef41bae7e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] HTTP exception thrown: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6cf57d7b-3b2d-4d8a-a3eb-116ef41bae7e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Request method failure captured: Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 HTTP/1.1 Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MNBTDCZ7vuHhKvRHlEolB_BW0oVjjNghGAxUIK_WfiG5SlIYB7JtF8WGOCWa0MS7l3cF996IDPMNyVGNRkTktVGp6mkHasP_zMBXg3OVYJp3jZybhGIjMqjC03Lw5CtORoMEpty1Jc2cK0RTv6UTCvion696PpRu7Z-Xpy2-a4KNjM Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 92e23c5c336e486f995f88c12b72b2c5 Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:23:38.374213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:23:38.375922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_92e23c5c336e486f995f88c12b72b2c5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:23:38.375922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:38.375922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 92e23c5c336e486f995f88c12b72b2c5 Aug 05 07:23:38.375922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:38.375922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeTestJSON-201491328-project Aug 05 07:23:38.375922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:23:38.375922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:23:38.375922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 02c685b300874351ab2dbd62bea1a669 Aug 05 07:23:38.375922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeTestJSON-201491328-project Aug 05 07:23:38.375922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:23:38.375922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:38.375922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '1cd3c1c0-4733-45dc-ab55-794aa3ea12e9'} Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:23:38.376867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:38.378555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:38.380021 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6cf57d7b-3b2d-4d8a-a3eb-116ef41bae7e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Returning 404 to user: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:23:38.380396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6cf57d7b-3b2d-4d8a-a3eb-116ef41bae7e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 404 len: 111 microversion: 2.1 time: 0.041897 Aug 05 07:23:38.384554 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 442/895] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:38 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:23:38.390405 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-12075a34-8bd3-4b97-98db-6883b0a9d718 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '.version_select at 0x7f49747750d0>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:38.423287 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-12075a34-8bd3-4b97-98db-6883b0a9d718 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542233691" status: 202 len: 0 microversion: 2.1 time: 0.036843 Aug 05 07:23:38.423947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 454/896] 10.222.0.27 () {58 vars in 1221 bytes} [Fri Aug 5 07:23:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542233691 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:23:38.597392 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fd7079b0-3c69-431c-8ed0-bd11b9856335 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:38.599149 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fd7079b0-3c69-431c-8ed0-bd11b9856335 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:38.611410 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd7079b0-3c69-431c-8ed0-bd11b9856335 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:38.612359 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd7079b0-3c69-431c-8ed0-bd11b9856335 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:38.613255 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd7079b0-3c69-431c-8ed0-bd11b9856335 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:38.614322 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd7079b0-3c69-431c-8ed0-bd11b9856335 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:38.615254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd7079b0-3c69-431c-8ed0-bd11b9856335 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:38.617061 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd7079b0-3c69-431c-8ed0-bd11b9856335 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:38.789784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fd7079b0-3c69-431c-8ed0-bd11b9856335 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:38.812113 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fd7079b0-3c69-431c-8ed0-bd11b9856335 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1547 microversion: 2.1 time: 0.222438 Aug 05 07:23:38.813584 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 443/897] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:38 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1547 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:38.838206 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-628da69b-cf20-46cf-9bb7-0778fb45a3a1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:38.838936 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-628da69b-cf20-46cf-9bb7-0778fb45a3a1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:38.856566 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-628da69b-cf20-46cf-9bb7-0778fb45a3a1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:38.857456 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-628da69b-cf20-46cf-9bb7-0778fb45a3a1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:38.858045 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-628da69b-cf20-46cf-9bb7-0778fb45a3a1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:38.858880 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-628da69b-cf20-46cf-9bb7-0778fb45a3a1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:38.859436 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-628da69b-cf20-46cf-9bb7-0778fb45a3a1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:38.859934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-628da69b-cf20-46cf-9bb7-0778fb45a3a1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:39.017027 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9c3e9f39-4855-4853-8229-3a6456e291e2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:39.018563 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9c3e9f39-4855-4853-8229-3a6456e291e2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:39.026203 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c3e9f39-4855-4853-8229-3a6456e291e2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:39.027197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c3e9f39-4855-4853-8229-3a6456e291e2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:39.028359 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c3e9f39-4855-4853-8229-3a6456e291e2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:39.029184 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c3e9f39-4855-4853-8229-3a6456e291e2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:39.029715 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c3e9f39-4855-4853-8229-3a6456e291e2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:39.030210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c3e9f39-4855-4853-8229-3a6456e291e2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:39.103555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-628da69b-cf20-46cf-9bb7-0778fb45a3a1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:39.114013 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-628da69b-cf20-46cf-9bb7-0778fb45a3a1 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1547 microversion: 2.1 time: 0.280113 Aug 05 07:23:39.120193 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 455/898] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:38 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1547 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:39.139193 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-81c37f77-4435-48fd-add2-da5458912dc8 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:39.144994 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-81c37f77-4435-48fd-add2-da5458912dc8 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:39.151194 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-81c37f77-4435-48fd-add2-da5458912dc8 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Searching by: {'deleted': False, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0'} {{(pid=117894) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 05 07:23:39.164355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-81c37f77-4435-48fd-add2-da5458912dc8 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:39.165382 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-81c37f77-4435-48fd-add2-da5458912dc8 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:39.166718 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-81c37f77-4435-48fd-add2-da5458912dc8 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:39.167479 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-81c37f77-4435-48fd-add2-da5458912dc8 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:39.167933 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-81c37f77-4435-48fd-add2-da5458912dc8 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:39.168346 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-81c37f77-4435-48fd-add2-da5458912dc8 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:39.190651 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9c3e9f39-4855-4853-8229-3a6456e291e2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:39.201779 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9c3e9f39-4855-4853-8229-3a6456e291e2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:39.203591 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9c3e9f39-4855-4853-8229-3a6456e291e2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:39.204989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9c3e9f39-4855-4853-8229-3a6456e291e2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1739 microversion: 2.20 time: 0.192877 Aug 05 07:23:39.205978 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 444/899] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:39 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:23:39.282908 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.multi_cell_list [None req-81c37f77-4435-48fd-add2-da5458912dc8 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117894) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 05 07:23:39.418651 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-81c37f77-4435-48fd-add2-da5458912dc8 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.284853 Aug 05 07:23:39.420025 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 456/900] 10.222.0.27 () {58 vars in 1125 bytes} [Fri Aug 5 07:23:39 2022] GET /compute/v2.1/servers => generated 342 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:23:39.432884 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-67571ede-3365-48ca-bf31-f25d1fa1d1f2 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:39.433557 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-67571ede-3365-48ca-bf31-f25d1fa1d1f2 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:39.441176 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67571ede-3365-48ca-bf31-f25d1fa1d1f2 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:39.441713 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67571ede-3365-48ca-bf31-f25d1fa1d1f2 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:39.442204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67571ede-3365-48ca-bf31-f25d1fa1d1f2 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:39.443186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67571ede-3365-48ca-bf31-f25d1fa1d1f2 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:39.443767 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67571ede-3365-48ca-bf31-f25d1fa1d1f2 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:39.444379 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67571ede-3365-48ca-bf31-f25d1fa1d1f2 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:39.613730 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-67571ede-3365-48ca-bf31-f25d1fa1d1f2 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:39.626062 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-67571ede-3365-48ca-bf31-f25d1fa1d1f2 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1547 microversion: 2.1 time: 0.196758 Aug 05 07:23:39.627498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 445/901] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:39 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1547 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:23:40.228428 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f3c9c1e9-d334-4c36-8ba2-61739e5850da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:40.229506 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f3c9c1e9-d334-4c36-8ba2-61739e5850da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:40.236812 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f3c9c1e9-d334-4c36-8ba2-61739e5850da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:40.237486 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f3c9c1e9-d334-4c36-8ba2-61739e5850da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:40.237980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f3c9c1e9-d334-4c36-8ba2-61739e5850da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:40.238771 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f3c9c1e9-d334-4c36-8ba2-61739e5850da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:40.239323 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f3c9c1e9-d334-4c36-8ba2-61739e5850da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:40.239843 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f3c9c1e9-d334-4c36-8ba2-61739e5850da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:40.566837 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f3c9c1e9-d334-4c36-8ba2-61739e5850da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:40.575340 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f3c9c1e9-d334-4c36-8ba2-61739e5850da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:40.576857 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f3c9c1e9-d334-4c36-8ba2-61739e5850da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:40.578055 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f3c9c1e9-d334-4c36-8ba2-61739e5850da tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1739 microversion: 2.20 time: 0.354100 Aug 05 07:23:40.578609 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 457/902] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:40 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1739 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:41.601057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bfe10133-294a-4082-99af-f172c6cf7b1c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:41.601840 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bfe10133-294a-4082-99af-f172c6cf7b1c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:41.614857 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bfe10133-294a-4082-99af-f172c6cf7b1c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:41.615543 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bfe10133-294a-4082-99af-f172c6cf7b1c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:41.615974 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bfe10133-294a-4082-99af-f172c6cf7b1c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:41.616686 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bfe10133-294a-4082-99af-f172c6cf7b1c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:41.617209 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bfe10133-294a-4082-99af-f172c6cf7b1c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:41.618018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bfe10133-294a-4082-99af-f172c6cf7b1c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:42.027330 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bfe10133-294a-4082-99af-f172c6cf7b1c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:42.039878 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bfe10133-294a-4082-99af-f172c6cf7b1c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:42.042347 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bfe10133-294a-4082-99af-f172c6cf7b1c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:42.043820 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bfe10133-294a-4082-99af-f172c6cf7b1c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1739 microversion: 2.20 time: 0.447098 Aug 05 07:23:42.044599 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 446/903] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:41 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1739 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:42.901234 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-96ed4054-af0c-4f3f-9619-0e496ec2968a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:42.901849 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-96ed4054-af0c-4f3f-9619-0e496ec2968a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:42.910371 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96ed4054-af0c-4f3f-9619-0e496ec2968a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:42.910823 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96ed4054-af0c-4f3f-9619-0e496ec2968a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:42.911471 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96ed4054-af0c-4f3f-9619-0e496ec2968a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:42.912176 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96ed4054-af0c-4f3f-9619-0e496ec2968a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:42.912667 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96ed4054-af0c-4f3f-9619-0e496ec2968a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:42.913115 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96ed4054-af0c-4f3f-9619-0e496ec2968a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:42.940494 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-96ed4054-af0c-4f3f-9619-0e496ec2968a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/ips" status: 200 len: 150 microversion: 2.1 time: 0.043381 Aug 05 07:23:42.947714 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 458/904] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 5 07:23:42 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:43.067452 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c627dabd-8062-4f3c-a595-e77109c92784 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:43.069142 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c627dabd-8062-4f3c-a595-e77109c92784 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:43.076267 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c627dabd-8062-4f3c-a595-e77109c92784 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:43.076964 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c627dabd-8062-4f3c-a595-e77109c92784 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:43.077571 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c627dabd-8062-4f3c-a595-e77109c92784 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:43.078433 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c627dabd-8062-4f3c-a595-e77109c92784 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:43.079028 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c627dabd-8062-4f3c-a595-e77109c92784 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:43.079901 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c627dabd-8062-4f3c-a595-e77109c92784 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:43.233934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1866338057", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1981702890", "security_groups": [{"name": "tempest-secgroup-smoke-58290517"}], "block_device_mapping_v2": [{"uuid": "61c9c46c-d349-4488-8fb2-298098eb2814", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "898bc1bf-853e-4d5f-beef-8e86d982e4a4"}]}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:43.252939 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c627dabd-8062-4f3c-a595-e77109c92784 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:43.270054 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c627dabd-8062-4f3c-a595-e77109c92784 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:43.274116 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c627dabd-8062-4f3c-a595-e77109c92784 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:43.275765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c627dabd-8062-4f3c-a595-e77109c92784 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1739 microversion: 2.20 time: 0.212432 Aug 05 07:23:43.276874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 447/905] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:43 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:43.393500 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] validate_networks() for [('898bc1bf-853e-4d5f-beef-8e86d982e4a4', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:23:43.453212 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-df678f86-e492-4d74-94a8-37e7b16e4186 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53ffbcc8-57fa-456e-a6da-f69f13d5e44d"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:43.455761 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-df678f86-e492-4d74-94a8-37e7b16e4186 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:43.462197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df678f86-e492-4d74-94a8-37e7b16e4186 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:43.462748 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df678f86-e492-4d74-94a8-37e7b16e4186 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:43.463268 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df678f86-e492-4d74-94a8-37e7b16e4186 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:43.464025 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df678f86-e492-4d74-94a8-37e7b16e4186 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:43.464535 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df678f86-e492-4d74-94a8-37e7b16e4186 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:43.465078 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df678f86-e492-4d74-94a8-37e7b16e4186 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:43.796109 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-df678f86-e492-4d74-94a8-37e7b16e4186 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "POST /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346852 Aug 05 07:23:43.796970 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 448/906] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:23:43 2022] POST /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:23:44.050865 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:23:44.051388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:23:44.051977 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:23:44.052376 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:23:44.052784 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:23:44.062908 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:44.063385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:44.063809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:44.064518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:44.064982 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:44.065395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:44.081992 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Getting quotas for project 2720b0660de14a19a05ef57efaa01cd8. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:23:44.085884 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Getting quotas for user 43ef613541cb4fd49faa3a3cec1a58c8 and project 2720b0660de14a19a05ef57efaa01cd8. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:23:44.154310 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:23:44.157220 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61c9c46c-d349-4488-8fb2-298098eb2814',volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:23:44.308487 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-54b0d947-c9c8-4c42-822c-871be0ba6ea2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:44.309740 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-54b0d947-c9c8-4c42-822c-871be0ba6ea2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:44.337922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-54b0d947-c9c8-4c42-822c-871be0ba6ea2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:44.338469 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-54b0d947-c9c8-4c42-822c-871be0ba6ea2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:44.338969 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-54b0d947-c9c8-4c42-822c-871be0ba6ea2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:44.339767 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-54b0d947-c9c8-4c42-822c-871be0ba6ea2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:44.340457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-54b0d947-c9c8-4c42-822c-871be0ba6ea2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:44.341124 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-54b0d947-c9c8-4c42-822c-871be0ba6ea2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:44.349124 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:44.376575 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-72af9de8-49b8-4577-bdef-857be0d9c6ab tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.148081 Aug 05 07:23:44.377260 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 459/907] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:23:43 2022] POST /compute/v2.1/servers => generated 404 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 07:23:44.397742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-18f29eb7-3705-4732-9adc-694de7dfb407 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:44.398281 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-18f29eb7-3705-4732-9adc-694de7dfb407 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:44.483471 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-18f29eb7-3705-4732-9adc-694de7dfb407 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:44.494244 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-18f29eb7-3705-4732-9adc-694de7dfb407 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1095 microversion: 2.1 time: 0.102592 Aug 05 07:23:44.495583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 460/908] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:44 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:44.501885 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-bb3523bc-5ac8-4063-9dda-150ff79fd916 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62888255-1b03-4d79-8d61-37eba356fe43"}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:44.506017 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-bb3523bc-5ac8-4063-9dda-150ff79fd916 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:44.514143 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bb3523bc-5ac8-4063-9dda-150ff79fd916 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:44.515186 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bb3523bc-5ac8-4063-9dda-150ff79fd916 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:44.516046 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bb3523bc-5ac8-4063-9dda-150ff79fd916 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:44.516888 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bb3523bc-5ac8-4063-9dda-150ff79fd916 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:44.517235 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bb3523bc-5ac8-4063-9dda-150ff79fd916 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:44.522378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bb3523bc-5ac8-4063-9dda-150ff79fd916 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:44.612042 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-54b0d947-c9c8-4c42-822c-871be0ba6ea2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:44.628126 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-54b0d947-c9c8-4c42-822c-871be0ba6ea2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:44.629794 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-54b0d947-c9c8-4c42-822c-871be0ba6ea2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:44.631116 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-54b0d947-c9c8-4c42-822c-871be0ba6ea2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1721 microversion: 2.20 time: 0.331673 Aug 05 07:23:44.631889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 449/909] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:44 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1721 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:44.874765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4287fc32-3aa3-4f47-bfcf-eeafc4004449 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:44.875113 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-bb3523bc-5ac8-4063-9dda-150ff79fd916 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "POST /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378095 Aug 05 07:23:44.875863 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4287fc32-3aa3-4f47-bfcf-eeafc4004449 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:44.876010 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 461/910] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:23:44 2022] POST /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:44.893294 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4287fc32-3aa3-4f47-bfcf-eeafc4004449 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:44.895341 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4287fc32-3aa3-4f47-bfcf-eeafc4004449 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:44.895925 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4287fc32-3aa3-4f47-bfcf-eeafc4004449 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:44.898073 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4287fc32-3aa3-4f47-bfcf-eeafc4004449 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:44.898561 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4287fc32-3aa3-4f47-bfcf-eeafc4004449 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:44.898994 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4287fc32-3aa3-4f47-bfcf-eeafc4004449 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:44.926957 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-4287fc32-3aa3-4f47-bfcf-eeafc4004449 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] HTTP exception thrown: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4287fc32-3aa3-4f47-bfcf-eeafc4004449 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Request method failure captured: Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 HTTP/1.1 Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MNBTDCZ7vuHhKvRHlEolB_BW0oVjjNghGAxUIK_WfiG5SlIYB7JtF8WGOCWa0MS7l3cF996IDPMNyVGNRkTktVGp6mkHasP_zMBXg3OVYJp3jZybhGIjMqjC03Lw5CtORoMEpty1Jc2cK0RTv6UTCvion696PpRu7Z-Xpy2-a4KNjM Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 92e23c5c336e486f995f88c12b72b2c5 Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:23:44.929695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:23:44.931430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_92e23c5c336e486f995f88c12b72b2c5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:23:44.931430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:44.931430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 92e23c5c336e486f995f88c12b72b2c5 Aug 05 07:23:44.931430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:44.931430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeTestJSON-201491328-project Aug 05 07:23:44.931430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:23:44.931430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:23:44.931430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 02c685b300874351ab2dbd62bea1a669 Aug 05 07:23:44.931430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeTestJSON-201491328-project Aug 05 07:23:44.931430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:23:44.931430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:44.931430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '1cd3c1c0-4733-45dc-ab55-794aa3ea12e9'} Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:23:44.932736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:44.935057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:44.936620 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4287fc32-3aa3-4f47-bfcf-eeafc4004449 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Returning 404 to user: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:23:44.936620 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4287fc32-3aa3-4f47-bfcf-eeafc4004449 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 404 len: 111 microversion: 2.1 time: 0.061718 Aug 05 07:23:44.936620 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 450/911] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:23:44 2022] DELETE /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:23:44.942178 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8e4671a5-1c8e-4781-b6fd-c85987dfcc91 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:44.942889 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8e4671a5-1c8e-4781-b6fd-c85987dfcc91 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:44.950113 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e4671a5-1c8e-4781-b6fd-c85987dfcc91 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:44.950603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e4671a5-1c8e-4781-b6fd-c85987dfcc91 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:44.951038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e4671a5-1c8e-4781-b6fd-c85987dfcc91 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:44.951921 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e4671a5-1c8e-4781-b6fd-c85987dfcc91 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:44.952372 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e4671a5-1c8e-4781-b6fd-c85987dfcc91 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:44.952790 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8e4671a5-1c8e-4781-b6fd-c85987dfcc91 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:44.988082 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-8e4671a5-1c8e-4781-b6fd-c85987dfcc91 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] HTTP exception thrown: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8e4671a5-1c8e-4781-b6fd-c85987dfcc91 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Request method failure captured: Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 HTTP/1.1 Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MNBTDCZ7vuHhKvRHlEolB_BW0oVjjNghGAxUIK_WfiG5SlIYB7JtF8WGOCWa0MS7l3cF996IDPMNyVGNRkTktVGp6mkHasP_zMBXg3OVYJp3jZybhGIjMqjC03Lw5CtORoMEpty1Jc2cK0RTv6UTCvion696PpRu7Z-Xpy2-a4KNjM Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 92e23c5c336e486f995f88c12b72b2c5 Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:23:44.990238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:23:44.991934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_92e23c5c336e486f995f88c12b72b2c5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:23:44.991934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:44.991934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 92e23c5c336e486f995f88c12b72b2c5 Aug 05 07:23:44.991934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:44.991934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeTestJSON-201491328-project Aug 05 07:23:44.991934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:23:44.991934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:23:44.991934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 02c685b300874351ab2dbd62bea1a669 Aug 05 07:23:44.991934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeTestJSON-201491328-project Aug 05 07:23:44.991934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:23:44.991934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:44.991934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': '1cd3c1c0-4733-45dc-ab55-794aa3ea12e9'} Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:23:44.993020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. Aug 05 07:23:44.994564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:23:44.996037 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8e4671a5-1c8e-4781-b6fd-c85987dfcc91 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Returning 404 to user: Instance 1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:23:44.996037 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8e4671a5-1c8e-4781-b6fd-c85987dfcc91 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9" status: 404 len: 111 microversion: 2.1 time: 0.054876 Aug 05 07:23:44.996037 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 462/912] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:44 2022] GET /compute/v2.1/servers/1cd3c1c0-4733-45dc-ab55-794aa3ea12e9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:23:45.515871 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-86edec7a-dd2f-4634-867b-ec3163df3867 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:45.516601 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-86edec7a-dd2f-4634-867b-ec3163df3867 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:45.523806 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86edec7a-dd2f-4634-867b-ec3163df3867 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:45.524356 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86edec7a-dd2f-4634-867b-ec3163df3867 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:45.524787 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86edec7a-dd2f-4634-867b-ec3163df3867 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:45.525513 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86edec7a-dd2f-4634-867b-ec3163df3867 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:45.525963 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86edec7a-dd2f-4634-867b-ec3163df3867 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:45.526385 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86edec7a-dd2f-4634-867b-ec3163df3867 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:45.597270 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-86edec7a-dd2f-4634-867b-ec3163df3867 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:45.606944 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-86edec7a-dd2f-4634-867b-ec3163df3867 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1193 microversion: 2.1 time: 0.095193 Aug 05 07:23:45.607569 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 451/913] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:45 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:45.658250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2c04b488-e4d7-4375-a8e0-a249cf430ad5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:45.658844 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-2c04b488-e4d7-4375-a8e0-a249cf430ad5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:45.665771 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2c04b488-e4d7-4375-a8e0-a249cf430ad5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:45.666245 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2c04b488-e4d7-4375-a8e0-a249cf430ad5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:45.666679 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2c04b488-e4d7-4375-a8e0-a249cf430ad5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:45.667337 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2c04b488-e4d7-4375-a8e0-a249cf430ad5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:45.667783 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2c04b488-e4d7-4375-a8e0-a249cf430ad5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:45.668198 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-2c04b488-e4d7-4375-a8e0-a249cf430ad5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:45.819685 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2c04b488-e4d7-4375-a8e0-a249cf430ad5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:45.831627 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2c04b488-e4d7-4375-a8e0-a249cf430ad5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:45.833814 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-2c04b488-e4d7-4375-a8e0-a249cf430ad5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:45.835232 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2c04b488-e4d7-4375-a8e0-a249cf430ad5 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1721 microversion: 2.20 time: 0.181090 Aug 05 07:23:45.835790 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 463/914] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:45 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:46.205888 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a2458fcb-975a-471b-830c-a232b9e69cf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:46.206592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a2458fcb-975a-471b-830c-a232b9e69cf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:46.215273 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2458fcb-975a-471b-830c-a232b9e69cf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:46.215955 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2458fcb-975a-471b-830c-a232b9e69cf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:46.216525 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2458fcb-975a-471b-830c-a232b9e69cf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:46.217536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2458fcb-975a-471b-830c-a232b9e69cf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:46.218098 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2458fcb-975a-471b-830c-a232b9e69cf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:46.218683 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a2458fcb-975a-471b-830c-a232b9e69cf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:46.234340 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-a2458fcb-975a-471b-830c-a232b9e69cf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] HTTP exception thrown: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a2458fcb-975a-471b-830c-a232b9e69cf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Request method failure captured: Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 HTTP/1.1 Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MNBTDCZ7vuHhKvRHlEolB_BW0oVjjNghGAxUIK_WfiG5SlIYB7JtF8WGOCWa0MS7l3cF996IDPMNyVGNRkTktVGp6mkHasP_zMBXg3OVYJp3jZybhGIjMqjC03Lw5CtORoMEpty1Jc2cK0RTv6UTCvion696PpRu7Z-Xpy2-a4KNjM Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 92e23c5c336e486f995f88c12b72b2c5 Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:23:46.235872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:23:46.237506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_92e23c5c336e486f995f88c12b72b2c5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:23:46.237506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:46.237506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 92e23c5c336e486f995f88c12b72b2c5 Aug 05 07:23:46.237506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:46.237506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeTestJSON-201491328-project Aug 05 07:23:46.237506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:23:46.237506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:23:46.237506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 02c685b300874351ab2dbd62bea1a669 Aug 05 07:23:46.237506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeTestJSON-201491328-project Aug 05 07:23:46.237506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:23:46.237506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:23:46.237506 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'acf59ded-e598-4ac7-ba2e-9a3c2210d007'} Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:23:46.238331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:23:46.239608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:23:46.240815 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a2458fcb-975a-471b-830c-a232b9e69cf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Returning 404 to user: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:23:46.240815 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a2458fcb-975a-471b-830c-a232b9e69cf2 tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "DELETE /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 404 len: 111 microversion: 2.1 time: 0.037401 Aug 05 07:23:46.240815 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 452/915] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:23:46 2022] DELETE /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:23:46.246354 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d4995e47-4118-4dcf-b5c2-85071a2e2c0e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:46.246966 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d4995e47-4118-4dcf-b5c2-85071a2e2c0e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] [instance: acf59ded-e598-4ac7-ba2e-9a3c2210d007] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:46.253865 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4995e47-4118-4dcf-b5c2-85071a2e2c0e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:46.254351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4995e47-4118-4dcf-b5c2-85071a2e2c0e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:46.254786 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4995e47-4118-4dcf-b5c2-85071a2e2c0e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:46.255483 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4995e47-4118-4dcf-b5c2-85071a2e2c0e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:46.255929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4995e47-4118-4dcf-b5c2-85071a2e2c0e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:46.256410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4995e47-4118-4dcf-b5c2-85071a2e2c0e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:46.270920 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-d4995e47-4118-4dcf-b5c2-85071a2e2c0e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] HTTP exception thrown: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d4995e47-4118-4dcf-b5c2-85071a2e2c0e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Request method failure captured: Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 HTTP/1.1 Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MNBTDCZ7vuHhKvRHlEolB_BW0oVjjNghGAxUIK_WfiG5SlIYB7JtF8WGOCWa0MS7l3cF996IDPMNyVGNRkTktVGp6mkHasP_zMBXg3OVYJp3jZybhGIjMqjC03Lw5CtORoMEpty1Jc2cK0RTv6UTCvion696PpRu7Z-Xpy2-a4KNjM Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 92e23c5c336e486f995f88c12b72b2c5 Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:23:46.272467 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:23:46.275363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_92e23c5c336e486f995f88c12b72b2c5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/92e23c5c336e486f995f88c12b72b2c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:23:46.275363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:46.275363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 92e23c5c336e486f995f88c12b72b2c5 Aug 05 07:23:46.275363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeTestJSON-201491328 Aug 05 07:23:46.275363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeTestJSON-201491328-project Aug 05 07:23:46.275363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:23:46.275363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:23:46.275363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 02c685b300874351ab2dbd62bea1a669 Aug 05 07:23:46.275363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeTestJSON-201491328-project Aug 05 07:23:46.275363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:23:46.275363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:23:46.275363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'acf59ded-e598-4ac7-ba2e-9a3c2210d007'} Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:23:46.276918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. Aug 05 07:23:46.279590 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:23:46.282157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d4995e47-4118-4dcf-b5c2-85071a2e2c0e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] Returning 404 to user: Instance acf59ded-e598-4ac7-ba2e-9a3c2210d007 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:23:46.282157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d4995e47-4118-4dcf-b5c2-85071a2e2c0e tempest-AttachVolumeTestJSON-201491328 tempest-AttachVolumeTestJSON-201491328-project] 10.222.0.27 "GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007" status: 404 len: 111 microversion: 2.1 time: 0.031549 Aug 05 07:23:46.282157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 464/916] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:46 2022] GET /compute/v2.1/servers/acf59ded-e598-4ac7-ba2e-9a3c2210d007 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:23:46.629612 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0b0f16ee-c4b6-4439-aab6-b3db836edb68 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:46.630182 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0b0f16ee-c4b6-4439-aab6-b3db836edb68 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:46.637596 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0b0f16ee-c4b6-4439-aab6-b3db836edb68 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:46.638092 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0b0f16ee-c4b6-4439-aab6-b3db836edb68 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:46.638528 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0b0f16ee-c4b6-4439-aab6-b3db836edb68 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:46.639240 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0b0f16ee-c4b6-4439-aab6-b3db836edb68 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:46.639699 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0b0f16ee-c4b6-4439-aab6-b3db836edb68 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:46.640120 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0b0f16ee-c4b6-4439-aab6-b3db836edb68 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:46.717368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0b0f16ee-c4b6-4439-aab6-b3db836edb68 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:46.725073 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0b0f16ee-c4b6-4439-aab6-b3db836edb68 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1193 microversion: 2.1 time: 0.099438 Aug 05 07:23:46.725615 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 453/917] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:46 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:46.862140 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-46bbff66-b393-4b28-9d26-9b20b5d9de65 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:46.862721 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-46bbff66-b393-4b28-9d26-9b20b5d9de65 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:46.869348 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46bbff66-b393-4b28-9d26-9b20b5d9de65 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:46.869824 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46bbff66-b393-4b28-9d26-9b20b5d9de65 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:46.870249 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46bbff66-b393-4b28-9d26-9b20b5d9de65 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:46.870943 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46bbff66-b393-4b28-9d26-9b20b5d9de65 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:46.871387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46bbff66-b393-4b28-9d26-9b20b5d9de65 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:46.871775 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46bbff66-b393-4b28-9d26-9b20b5d9de65 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:47.003809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-46bbff66-b393-4b28-9d26-9b20b5d9de65 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:47.013117 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-46bbff66-b393-4b28-9d26-9b20b5d9de65 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:47.014595 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-46bbff66-b393-4b28-9d26-9b20b5d9de65 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:47.015752 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-46bbff66-b393-4b28-9d26-9b20b5d9de65 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1721 microversion: 2.20 time: 0.157696 Aug 05 07:23:47.016281 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 465/918] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:46 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:47.745861 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d64a069f-a151-4eca-ac6e-7401685edbe7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:47.746530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d64a069f-a151-4eca-ac6e-7401685edbe7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:47.754001 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d64a069f-a151-4eca-ac6e-7401685edbe7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:47.754487 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d64a069f-a151-4eca-ac6e-7401685edbe7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:47.754908 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d64a069f-a151-4eca-ac6e-7401685edbe7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:47.755798 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d64a069f-a151-4eca-ac6e-7401685edbe7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:47.756634 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d64a069f-a151-4eca-ac6e-7401685edbe7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:47.757273 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d64a069f-a151-4eca-ac6e-7401685edbe7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:47.846688 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d64a069f-a151-4eca-ac6e-7401685edbe7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:47.855276 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d64a069f-a151-4eca-ac6e-7401685edbe7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1201 microversion: 2.1 time: 0.113376 Aug 05 07:23:47.855820 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 454/919] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:47 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1201 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:48.044061 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a6ad2f83-70d3-41a4-a3b0-6155d3fcdfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:48.045863 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a6ad2f83-70d3-41a4-a3b0-6155d3fcdfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:48.054914 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a6ad2f83-70d3-41a4-a3b0-6155d3fcdfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:48.055642 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a6ad2f83-70d3-41a4-a3b0-6155d3fcdfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:48.056393 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a6ad2f83-70d3-41a4-a3b0-6155d3fcdfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:48.057816 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a6ad2f83-70d3-41a4-a3b0-6155d3fcdfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:48.058849 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a6ad2f83-70d3-41a4-a3b0-6155d3fcdfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:48.059773 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a6ad2f83-70d3-41a4-a3b0-6155d3fcdfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:48.316578 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a6ad2f83-70d3-41a4-a3b0-6155d3fcdfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:48.330216 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a6ad2f83-70d3-41a4-a3b0-6155d3fcdfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:48.332516 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a6ad2f83-70d3-41a4-a3b0-6155d3fcdfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:48.333799 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a6ad2f83-70d3-41a4-a3b0-6155d3fcdfba tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1724 microversion: 2.20 time: 0.297316 Aug 05 07:23:48.334399 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 466/920] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:48 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:48.360709 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-baf68745-88f0-4a1d-a4b3-c99ec46a58eb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b9a27f3-0aaf-4584-a549-a2723cfd8272"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:48.363428 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-baf68745-88f0-4a1d-a4b3-c99ec46a58eb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:48.369976 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-baf68745-88f0-4a1d-a4b3-c99ec46a58eb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:48.370623 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-baf68745-88f0-4a1d-a4b3-c99ec46a58eb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:48.371119 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-baf68745-88f0-4a1d-a4b3-c99ec46a58eb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:48.372006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-baf68745-88f0-4a1d-a4b3-c99ec46a58eb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:48.372467 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-baf68745-88f0-4a1d-a4b3-c99ec46a58eb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:48.372906 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-baf68745-88f0-4a1d-a4b3-c99ec46a58eb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:48.457613 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-67a4a088-d56c-4be2-b887-55977631da3e req-3a509809-2f25-4a72-8f1b-5ef7456559de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d197c94-dfa3-4fe2-974d-4134fb0cb595", "name": "network-vif-unplugged", "status": "completed", "tag": "155ed77d-f493-45be-ad25-67f9052f1659"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:48.478259 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-67a4a088-d56c-4be2-b887-55977631da3e req-3a509809-2f25-4a72-8f1b-5ef7456559de service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:48.479112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-67a4a088-d56c-4be2-b887-55977631da3e req-3a509809-2f25-4a72-8f1b-5ef7456559de service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:48.481698 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-67a4a088-d56c-4be2-b887-55977631da3e req-3a509809-2f25-4a72-8f1b-5ef7456559de service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:48.503736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-67a4a088-d56c-4be2-b887-55977631da3e req-3a509809-2f25-4a72-8f1b-5ef7456559de service nova] Creating event network-vif-unplugged:155ed77d-f493-45be-ad25-67f9052f1659 for instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 on hv-cinder-85200 Aug 05 07:23:48.514914 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-67a4a088-d56c-4be2-b887-55977631da3e req-3a509809-2f25-4a72-8f1b-5ef7456559de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060191 Aug 05 07:23:48.516806 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 467/921] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:23:48.876840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-547d2588-fb30-408a-84d4-d89b662a4071 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:48.877794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-547d2588-fb30-408a-84d4-d89b662a4071 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:48.884836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-547d2588-fb30-408a-84d4-d89b662a4071 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:48.885197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-baf68745-88f0-4a1d-a4b3-c99ec46a58eb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "POST /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.530199 Aug 05 07:23:48.886215 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-547d2588-fb30-408a-84d4-d89b662a4071 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:48.886706 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-547d2588-fb30-408a-84d4-d89b662a4071 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:48.887514 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-547d2588-fb30-408a-84d4-d89b662a4071 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:48.888140 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-547d2588-fb30-408a-84d4-d89b662a4071 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:48.888637 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-547d2588-fb30-408a-84d4-d89b662a4071 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:48.891624 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 455/922] 10.222.0.27 () {62 vars in 1364 bytes} [Fri Aug 5 07:23:48 2022] POST /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/os-volume_attachments => generated 188 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 07:23:48.960742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-547d2588-fb30-408a-84d4-d89b662a4071 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:48.969666 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-547d2588-fb30-408a-84d4-d89b662a4071 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1211 microversion: 2.1 time: 0.097208 Aug 05 07:23:48.970246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 468/923] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:48 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:23:49.019525 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2cb20a20-0214-4a11-96a9-8c2f72a963dc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:49.020015 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2cb20a20-0214-4a11-96a9-8c2f72a963dc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:49.026104 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2cb20a20-0214-4a11-96a9-8c2f72a963dc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:49.026541 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2cb20a20-0214-4a11-96a9-8c2f72a963dc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:49.027164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2cb20a20-0214-4a11-96a9-8c2f72a963dc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:49.028055 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2cb20a20-0214-4a11-96a9-8c2f72a963dc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:49.028505 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2cb20a20-0214-4a11-96a9-8c2f72a963dc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:49.028940 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2cb20a20-0214-4a11-96a9-8c2f72a963dc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:49.512424 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f0babaf8-c173-4538-8536-bf0583cb3162 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:49.513608 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f0babaf8-c173-4538-8536-bf0583cb3162 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:49.521474 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0babaf8-c173-4538-8536-bf0583cb3162 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:49.522314 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0babaf8-c173-4538-8536-bf0583cb3162 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:49.522748 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0babaf8-c173-4538-8536-bf0583cb3162 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:49.523448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0babaf8-c173-4538-8536-bf0583cb3162 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:49.523895 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0babaf8-c173-4538-8536-bf0583cb3162 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:49.524405 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f0babaf8-c173-4538-8536-bf0583cb3162 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:49.554757 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2cb20a20-0214-4a11-96a9-8c2f72a963dc tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/os-volume_attachments/4b9a27f3-0aaf-4584-a549-a2723cfd8272" status: 202 len: 0 microversion: 2.20 time: 0.538871 Aug 05 07:23:49.555788 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 456/924] 10.222.0.27 () {60 vars in 1457 bytes} [Fri Aug 5 07:23:49 2022] DELETE /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/os-volume_attachments/4b9a27f3-0aaf-4584-a549-a2723cfd8272 => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:23:49.630438 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1f835844-1877-4ee4-af57-67a1f74f8b89 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:49.631350 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1f835844-1877-4ee4-af57-67a1f74f8b89 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:49.639727 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1f835844-1877-4ee4-af57-67a1f74f8b89 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:49.640451 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1f835844-1877-4ee4-af57-67a1f74f8b89 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:49.641129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1f835844-1877-4ee4-af57-67a1f74f8b89 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:49.641869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1f835844-1877-4ee4-af57-67a1f74f8b89 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:49.642314 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1f835844-1877-4ee4-af57-67a1f74f8b89 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:49.642733 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1f835844-1877-4ee4-af57-67a1f74f8b89 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:49.678801 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1f835844-1877-4ee4-af57-67a1f74f8b89 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117893) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 07:23:49.688009 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f0babaf8-c173-4538-8536-bf0583cb3162 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:49.698657 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f0babaf8-c173-4538-8536-bf0583cb3162 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1593 microversion: 2.1 time: 0.191103 Aug 05 07:23:49.699539 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 469/925] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:49 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1593 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:23:49.781544 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1f835844-1877-4ee4-af57-67a1f74f8b89 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "POST /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/action" status: 202 len: 0 microversion: 2.20 time: 0.154683 Aug 05 07:23:49.787446 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 457/926] 10.222.0.27 () {62 vars in 1319 bytes} [Fri Aug 5 07:23:49 2022] POST /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:23:49.794831 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a899dd72-ad78-46a6-b28b-6020fec881f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:49.796315 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a899dd72-ad78-46a6-b28b-6020fec881f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:49.801096 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:49.813894 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a899dd72-ad78-46a6-b28b-6020fec881f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:49.814485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a899dd72-ad78-46a6-b28b-6020fec881f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:49.815199 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a899dd72-ad78-46a6-b28b-6020fec881f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:49.816279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a899dd72-ad78-46a6-b28b-6020fec881f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:49.816741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a899dd72-ad78-46a6-b28b-6020fec881f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:49.817485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a899dd72-ad78-46a6-b28b-6020fec881f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:49.992306 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c08d61c8-e732-4f95-b5ca-54012d7ef664 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:49.993051 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c08d61c8-e732-4f95-b5ca-54012d7ef664 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:49.999296 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c08d61c8-e732-4f95-b5ca-54012d7ef664 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:49.999944 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c08d61c8-e732-4f95-b5ca-54012d7ef664 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:50.000564 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c08d61c8-e732-4f95-b5ca-54012d7ef664 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:50.001729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c08d61c8-e732-4f95-b5ca-54012d7ef664 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:50.002384 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c08d61c8-e732-4f95-b5ca-54012d7ef664 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:50.003209 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c08d61c8-e732-4f95-b5ca-54012d7ef664 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:50.037933 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a899dd72-ad78-46a6-b28b-6020fec881f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:50.048146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a899dd72-ad78-46a6-b28b-6020fec881f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:50.049681 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a899dd72-ad78-46a6-b28b-6020fec881f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:50.050972 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a899dd72-ad78-46a6-b28b-6020fec881f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1672 microversion: 2.20 time: 0.261703 Aug 05 07:23:50.052935 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 470/927] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:49 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1672 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:50.521768 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c08d61c8-e732-4f95-b5ca-54012d7ef664 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:50.530866 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c08d61c8-e732-4f95-b5ca-54012d7ef664 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.544093 Aug 05 07:23:50.532102 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 458/928] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:49 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:23:51.079248 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1e8ba539-a484-4027-b715-4d082d4fb18b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:51.081698 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1e8ba539-a484-4027-b715-4d082d4fb18b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:51.094597 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1e8ba539-a484-4027-b715-4d082d4fb18b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:51.095654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1e8ba539-a484-4027-b715-4d082d4fb18b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:51.096664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1e8ba539-a484-4027-b715-4d082d4fb18b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:51.098952 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1e8ba539-a484-4027-b715-4d082d4fb18b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:51.099800 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1e8ba539-a484-4027-b715-4d082d4fb18b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:51.100575 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1e8ba539-a484-4027-b715-4d082d4fb18b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:51.486114 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1e8ba539-a484-4027-b715-4d082d4fb18b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:51.495445 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1e8ba539-a484-4027-b715-4d082d4fb18b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:51.496995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1e8ba539-a484-4027-b715-4d082d4fb18b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:51.498890 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1e8ba539-a484-4027-b715-4d082d4fb18b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1672 microversion: 2.20 time: 0.428177 Aug 05 07:23:51.499894 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 471/929] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:51 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1672 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:51.563385 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-412feed0-cafd-4ae6-9313-f00f0c051643 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:51.564316 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-412feed0-cafd-4ae6-9313-f00f0c051643 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:51.575251 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-412feed0-cafd-4ae6-9313-f00f0c051643 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:51.576420 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-412feed0-cafd-4ae6-9313-f00f0c051643 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:51.577323 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-412feed0-cafd-4ae6-9313-f00f0c051643 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:51.578663 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-412feed0-cafd-4ae6-9313-f00f0c051643 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:51.580362 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-412feed0-cafd-4ae6-9313-f00f0c051643 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:51.581268 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-412feed0-cafd-4ae6-9313-f00f0c051643 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:52.010178 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-412feed0-cafd-4ae6-9313-f00f0c051643 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:52.018335 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-412feed0-cafd-4ae6-9313-f00f0c051643 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.469967 Aug 05 07:23:52.018886 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 459/930] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:51 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:52.489690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-27022741-c0fa-4dcc-86c2-8e2c278210ae req-3b1c443d-dd0e-47c5-8b95-6d07dbc78490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45375909-399b-4df1-9ee9-5b29174c9a93", "tag": "dcba2fdc-7a5a-479c-9dad-258cf786441f"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:52.503681 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-27022741-c0fa-4dcc-86c2-8e2c278210ae req-3b1c443d-dd0e-47c5-8b95-6d07dbc78490 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:52.504238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-27022741-c0fa-4dcc-86c2-8e2c278210ae req-3b1c443d-dd0e-47c5-8b95-6d07dbc78490 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:52.504757 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-27022741-c0fa-4dcc-86c2-8e2c278210ae req-3b1c443d-dd0e-47c5-8b95-6d07dbc78490 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:52.520075 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-27022741-c0fa-4dcc-86c2-8e2c278210ae req-3b1c443d-dd0e-47c5-8b95-6d07dbc78490 service nova] Creating event network-changed:dcba2fdc-7a5a-479c-9dad-258cf786441f for instance 45375909-399b-4df1-9ee9-5b29174c9a93 on hv-cinder-85200 Aug 05 07:23:52.523668 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8ae79e05-3243-43d4-b638-91624733bd2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:52.523668 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8ae79e05-3243-43d4-b638-91624733bd2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:52.525040 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-27022741-c0fa-4dcc-86c2-8e2c278210ae req-3b1c443d-dd0e-47c5-8b95-6d07dbc78490 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040135 Aug 05 07:23:52.525631 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 472/931] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:52.525916 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:52.531908 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ae79e05-3243-43d4-b638-91624733bd2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:52.532531 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ae79e05-3243-43d4-b638-91624733bd2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:52.533086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ae79e05-3243-43d4-b638-91624733bd2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:52.533966 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ae79e05-3243-43d4-b638-91624733bd2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:52.534514 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ae79e05-3243-43d4-b638-91624733bd2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:52.535015 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ae79e05-3243-43d4-b638-91624733bd2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:52.838340 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9cd63695-2fca-45eb-a86e-bbb39c6a6d0c tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Action: 'create', calling method: .version_select at 0x7f49747c9550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1488942558"}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:52.999122 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8ae79e05-3243-43d4-b638-91624733bd2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:53.010390 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8ae79e05-3243-43d4-b638-91624733bd2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:53.012436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8ae79e05-3243-43d4-b638-91624733bd2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:53.014151 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8ae79e05-3243-43d4-b638-91624733bd2e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.495285 Aug 05 07:23:53.015271 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 460/932] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:52 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:53.041888 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-228f3e2d-b44e-4db6-b2f2-62ac76d376dc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:53.043279 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-228f3e2d-b44e-4db6-b2f2-62ac76d376dc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:53.050652 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-228f3e2d-b44e-4db6-b2f2-62ac76d376dc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:53.051476 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-228f3e2d-b44e-4db6-b2f2-62ac76d376dc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:53.052546 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-228f3e2d-b44e-4db6-b2f2-62ac76d376dc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:53.053478 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-228f3e2d-b44e-4db6-b2f2-62ac76d376dc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:53.054645 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-228f3e2d-b44e-4db6-b2f2-62ac76d376dc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:53.055562 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-228f3e2d-b44e-4db6-b2f2-62ac76d376dc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:53.079309 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:53.171238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9cd63695-2fca-45eb-a86e-bbb39c6a6d0c tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.459074 Aug 05 07:23:53.172580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 473/933] 10.222.0.27 () {60 vars in 1155 bytes} [Fri Aug 5 07:23:52 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 461 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 05 07:23:53.186015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b0ce0867-aceb-46ca-92d6-f6e110ef78f1 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4963e3aee0>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:53.241109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b0ce0867-aceb-46ca-92d6-f6e110ef78f1 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1" status: 200 len: 345 microversion: 2.1 time: 0.059737 Aug 05 07:23:53.241810 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 474/934] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:23:53 2022] GET /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:53.575012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-228f3e2d-b44e-4db6-b2f2-62ac76d376dc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:53.583677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-228f3e2d-b44e-4db6-b2f2-62ac76d376dc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.548406 Aug 05 07:23:53.584261 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 461/935] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:53 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:54.041998 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c78598ad-c933-4e90-adfc-1131c5c9d5e6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:54.043806 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c78598ad-c933-4e90-adfc-1131c5c9d5e6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:54.051056 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c78598ad-c933-4e90-adfc-1131c5c9d5e6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:54.051791 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c78598ad-c933-4e90-adfc-1131c5c9d5e6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:54.052739 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c78598ad-c933-4e90-adfc-1131c5c9d5e6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:54.054014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c78598ad-c933-4e90-adfc-1131c5c9d5e6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:54.054635 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c78598ad-c933-4e90-adfc-1131c5c9d5e6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:54.055270 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c78598ad-c933-4e90-adfc-1131c5c9d5e6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:54.075490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=4 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:54.223132 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c78598ad-c933-4e90-adfc-1131c5c9d5e6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:54.233134 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c78598ad-c933-4e90-adfc-1131c5c9d5e6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:54.234933 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c78598ad-c933-4e90-adfc-1131c5c9d5e6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:54.236398 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c78598ad-c933-4e90-adfc-1131c5c9d5e6 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.200227 Aug 05 07:23:54.237410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 475/936] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:54 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:54.268796 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7d60f319-d9f4-4728-be51-a11bded65968 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f49706190d0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:54.378850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7d60f319-d9f4-4728-be51-a11bded65968 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1" status: 200 len: 346 microversion: 2.1 time: 0.127111 Aug 05 07:23:54.379418 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 462/937] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:23:54 2022] GET /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1 => generated 346 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:23:54.392358 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-fc69c05c-f140-4e43-bbb5-171345aa1cb4 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Action: 'create', calling method: .version_select at 0x7f49747c9550>, body: {"snapshot": {"volume_id": "f8466518-76d2-4523-853d-7ddc6e8d07c1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1996883891"}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:54.488470 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=8 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:54.567900 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-f7917611-2e5e-4317-81ab-553cf82db7ad req-da631b9f-da22-400d-a6cd-01320291559f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f", "tag": "75147734-bff6-4247-ac9b-8d971477e25b"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:54.595389 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-f7917611-2e5e-4317-81ab-553cf82db7ad req-da631b9f-da22-400d-a6cd-01320291559f service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:54.597108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-f7917611-2e5e-4317-81ab-553cf82db7ad req-da631b9f-da22-400d-a6cd-01320291559f service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:54.597573 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-f7917611-2e5e-4317-81ab-553cf82db7ad req-da631b9f-da22-400d-a6cd-01320291559f service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:54.626012 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-f7917611-2e5e-4317-81ab-553cf82db7ad req-da631b9f-da22-400d-a6cd-01320291559f service nova] Creating event network-changed:75147734-bff6-4247-ac9b-8d971477e25b for instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f on hv-cinder-85200 Aug 05 07:23:54.638069 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-f7917611-2e5e-4317-81ab-553cf82db7ad req-da631b9f-da22-400d-a6cd-01320291559f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075205 Aug 05 07:23:54.639369 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 463/938] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:23:54.646618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-83323fa5-0412-4b9b-a87d-fe1108987c59 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:54.647594 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-83323fa5-0412-4b9b-a87d-fe1108987c59 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:54.654524 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83323fa5-0412-4b9b-a87d-fe1108987c59 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:54.657499 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83323fa5-0412-4b9b-a87d-fe1108987c59 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:54.659490 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83323fa5-0412-4b9b-a87d-fe1108987c59 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:54.661835 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83323fa5-0412-4b9b-a87d-fe1108987c59 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:54.662573 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83323fa5-0412-4b9b-a87d-fe1108987c59 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:54.665080 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83323fa5-0412-4b9b-a87d-fe1108987c59 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:54.717147 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-fc69c05c-f140-4e43-bbb5-171345aa1cb4 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.328633 Aug 05 07:23:54.717933 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 476/939] 10.222.0.27 () {60 vars in 1162 bytes} [Fri Aug 5 07:23:54 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:54.730950 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8631d10c-fa5b-472a-9f46-0eba5b26fc00 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4963f38430>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:54.822913 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8631d10c-fa5b-472a-9f46-0eba5b26fc00 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c" status: 200 len: 287 microversion: 2.1 time: 0.095504 Aug 05 07:23:54.822913 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 477/940] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 5 07:23:54 2022] GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:54.832276 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4cd4ec6e-2c15-4b9f-b637-8b8392778328 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4963e3a0d0>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:54.900181 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4cd4ec6e-2c15-4b9f-b637-8b8392778328 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.072134 Aug 05 07:23:54.907624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 478/941] 10.222.0.27 () {58 vars in 1140 bytes} [Fri Aug 5 07:23:54 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:23:54.912704 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9b18511a-08b9-4a6d-b92e-7e7bf0ebed48 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4963e67e50>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:54.992985 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9b18511a-08b9-4a6d-b92e-7e7bf0ebed48 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c" status: 200 len: 287 microversion: 2.1 time: 0.083931 Aug 05 07:23:54.993806 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 479/942] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 5 07:23:54 2022] GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:55.061394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-83323fa5-0412-4b9b-a87d-fe1108987c59 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:55.074283 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-83323fa5-0412-4b9b-a87d-fe1108987c59 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.433135 Aug 05 07:23:55.074895 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 464/943] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:54 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:55.268510 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-89f73f9f-fa59-4b57-a59a-cbd29f0180a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:55.269407 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-89f73f9f-fa59-4b57-a59a-cbd29f0180a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:55.284813 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-89f73f9f-fa59-4b57-a59a-cbd29f0180a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:55.285609 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-89f73f9f-fa59-4b57-a59a-cbd29f0180a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:55.289692 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-89f73f9f-fa59-4b57-a59a-cbd29f0180a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:55.290306 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-89f73f9f-fa59-4b57-a59a-cbd29f0180a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:55.290787 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-89f73f9f-fa59-4b57-a59a-cbd29f0180a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:55.291213 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-89f73f9f-fa59-4b57-a59a-cbd29f0180a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:55.339947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:55.604535 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-89f73f9f-fa59-4b57-a59a-cbd29f0180a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:55.620247 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-89f73f9f-fa59-4b57-a59a-cbd29f0180a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:55.625938 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-89f73f9f-fa59-4b57-a59a-cbd29f0180a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:55.642011 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-89f73f9f-fa59-4b57-a59a-cbd29f0180a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.365291 Aug 05 07:23:55.669282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 480/944] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:55 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:56.007363 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a21f1c7d-21b6-4c85-a08a-4f993d284fef tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f49706191f0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:56.054871 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a21f1c7d-21b6-4c85-a08a-4f993d284fef tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c" status: 200 len: 287 microversion: 2.1 time: 0.051720 Aug 05 07:23:56.057672 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 465/945] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 5 07:23:56 2022] GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:56.110121 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8eb7937d-bfe0-41cc-88b7-451ab9500b65 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:56.113993 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8eb7937d-bfe0-41cc-88b7-451ab9500b65 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:56.124735 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8eb7937d-bfe0-41cc-88b7-451ab9500b65 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:56.128423 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8eb7937d-bfe0-41cc-88b7-451ab9500b65 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:56.129132 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8eb7937d-bfe0-41cc-88b7-451ab9500b65 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:56.130119 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8eb7937d-bfe0-41cc-88b7-451ab9500b65 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:56.130618 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8eb7937d-bfe0-41cc-88b7-451ab9500b65 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:56.131119 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8eb7937d-bfe0-41cc-88b7-451ab9500b65 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:56.297790 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-8eb7937d-bfe0-41cc-88b7-451ab9500b65 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:56.306567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8eb7937d-bfe0-41cc-88b7-451ab9500b65 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.211912 Aug 05 07:23:56.307170 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 481/946] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:56 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:56.367041 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0e5b625a-5411-49f8-912d-982ced82e552 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-906244347"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:56.367580 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0e5b625a-5411-49f8-912d-982ced82e552 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:56.374508 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0e5b625a-5411-49f8-912d-982ced82e552 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:56.374981 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0e5b625a-5411-49f8-912d-982ced82e552 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:56.375405 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0e5b625a-5411-49f8-912d-982ced82e552 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:56.376118 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0e5b625a-5411-49f8-912d-982ced82e552 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:56.376561 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0e5b625a-5411-49f8-912d-982ced82e552 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:56.377016 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0e5b625a-5411-49f8-912d-982ced82e552 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:56.530259 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.network.security_group_api [None req-0e5b625a-5411-49f8-912d-982ced82e552 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Adding security group 9dd08194-5bc3-4587-a8c6-767b5363a7b5 to port 75147734-bff6-4247-ac9b-8d971477e25b Aug 05 07:23:56.674128 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ab9576b3-e6fc-471f-a689-052c947c13ed tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:56.674776 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ab9576b3-e6fc-471f-a689-052c947c13ed tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:56.681187 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ab9576b3-e6fc-471f-a689-052c947c13ed tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:56.681684 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ab9576b3-e6fc-471f-a689-052c947c13ed tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:56.682109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ab9576b3-e6fc-471f-a689-052c947c13ed tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:56.682808 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ab9576b3-e6fc-471f-a689-052c947c13ed tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:56.683254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ab9576b3-e6fc-471f-a689-052c947c13ed tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:56.683707 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ab9576b3-e6fc-471f-a689-052c947c13ed tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:56.856245 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ab9576b3-e6fc-471f-a689-052c947c13ed tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:56.893418 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ab9576b3-e6fc-471f-a689-052c947c13ed tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:56.896484 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ab9576b3-e6fc-471f-a689-052c947c13ed tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:56.902209 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ab9576b3-e6fc-471f-a689-052c947c13ed tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.232023 Aug 05 07:23:56.902930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 482/947] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:56 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:56.945996 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0e5b625a-5411-49f8-912d-982ced82e552 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "POST /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/action" status: 202 len: 0 microversion: 2.1 time: 0.583450 Aug 05 07:23:56.946609 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 466/948] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:23:56 2022] POST /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 07:23:56.955603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d4533e83-a3ce-4a36-a5e6-d44d974c78c3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:56.956348 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d4533e83-a3ce-4a36-a5e6-d44d974c78c3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:56.962924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-11d61b8b-2839-4f61-9c66-7454f9fa7513 req-0c67923a-c5f2-4e08-acbd-83edc2a73d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f", "tag": "75147734-bff6-4247-ac9b-8d971477e25b"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:23:56.964145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4533e83-a3ce-4a36-a5e6-d44d974c78c3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:56.964667 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4533e83-a3ce-4a36-a5e6-d44d974c78c3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:56.965151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4533e83-a3ce-4a36-a5e6-d44d974c78c3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:56.965867 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4533e83-a3ce-4a36-a5e6-d44d974c78c3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:56.966323 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4533e83-a3ce-4a36-a5e6-d44d974c78c3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:56.966748 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d4533e83-a3ce-4a36-a5e6-d44d974c78c3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:56.979647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-11d61b8b-2839-4f61-9c66-7454f9fa7513 req-0c67923a-c5f2-4e08-acbd-83edc2a73d49 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:56.980123 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-11d61b8b-2839-4f61-9c66-7454f9fa7513 req-0c67923a-c5f2-4e08-acbd-83edc2a73d49 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:56.980748 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-11d61b8b-2839-4f61-9c66-7454f9fa7513 req-0c67923a-c5f2-4e08-acbd-83edc2a73d49 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:57.004723 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-11d61b8b-2839-4f61-9c66-7454f9fa7513 req-0c67923a-c5f2-4e08-acbd-83edc2a73d49 service nova] Creating event network-changed:75147734-bff6-4247-ac9b-8d971477e25b for instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f on hv-cinder-85200 Aug 05 07:23:57.013391 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-11d61b8b-2839-4f61-9c66-7454f9fa7513 req-0c67923a-c5f2-4e08-acbd-83edc2a73d49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054806 Aug 05 07:23:57.015233 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 467/949] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:23:57.070881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9ee9000d-e5ca-4fde-9f18-7be5762a87eb tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4970715ee0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:57.111707 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9ee9000d-e5ca-4fde-9f18-7be5762a87eb tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c" status: 200 len: 287 microversion: 2.1 time: 0.045433 Aug 05 07:23:57.112297 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 468/950] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 5 07:23:57 2022] GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:23:57.202531 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d4533e83-a3ce-4a36-a5e6-d44d974c78c3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:57.216353 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d4533e83-a3ce-4a36-a5e6-d44d974c78c3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1639 microversion: 2.1 time: 0.261303 Aug 05 07:23:57.216353 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 483/951] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:56 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1639 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:57.342351 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b4c35f5c-79db-469d-a534-5e062bf80246 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:57.343164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b4c35f5c-79db-469d-a534-5e062bf80246 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:57.354029 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4c35f5c-79db-469d-a534-5e062bf80246 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:57.354843 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4c35f5c-79db-469d-a534-5e062bf80246 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:57.355705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4c35f5c-79db-469d-a534-5e062bf80246 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:57.356669 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4c35f5c-79db-469d-a534-5e062bf80246 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:57.357349 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4c35f5c-79db-469d-a534-5e062bf80246 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:57.357922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b4c35f5c-79db-469d-a534-5e062bf80246 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:57.557172 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b4c35f5c-79db-469d-a534-5e062bf80246 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:57.566334 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b4c35f5c-79db-469d-a534-5e062bf80246 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.228207 Aug 05 07:23:57.566860 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 469/952] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:57 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:57.928466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e71a12e0-80b1-44dd-8c1b-5b27116e2277 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:57.930288 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e71a12e0-80b1-44dd-8c1b-5b27116e2277 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:57.937581 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e71a12e0-80b1-44dd-8c1b-5b27116e2277 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:57.938075 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e71a12e0-80b1-44dd-8c1b-5b27116e2277 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:57.938514 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e71a12e0-80b1-44dd-8c1b-5b27116e2277 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:57.939227 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e71a12e0-80b1-44dd-8c1b-5b27116e2277 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:57.939676 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e71a12e0-80b1-44dd-8c1b-5b27116e2277 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:57.940302 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e71a12e0-80b1-44dd-8c1b-5b27116e2277 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:58.087007 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e71a12e0-80b1-44dd-8c1b-5b27116e2277 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:58.095784 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e71a12e0-80b1-44dd-8c1b-5b27116e2277 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:58.097334 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e71a12e0-80b1-44dd-8c1b-5b27116e2277 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:58.098528 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e71a12e0-80b1-44dd-8c1b-5b27116e2277 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.174349 Aug 05 07:23:58.099652 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 484/953] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:57 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:58.124413 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-de2ce3a9-7281-4cdf-940b-4255d256ac39 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4970715310>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:58.156318 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-de2ce3a9-7281-4cdf-940b-4255d256ac39 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c" status: 200 len: 287 microversion: 2.1 time: 0.035728 Aug 05 07:23:58.156911 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 470/954] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 5 07:23:58 2022] GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:23:58.588637 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c27b4848-ec0b-4d7c-b89f-de21a7cae88d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:58.589540 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c27b4848-ec0b-4d7c-b89f-de21a7cae88d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:58.596517 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c27b4848-ec0b-4d7c-b89f-de21a7cae88d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:58.597140 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c27b4848-ec0b-4d7c-b89f-de21a7cae88d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:58.597637 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c27b4848-ec0b-4d7c-b89f-de21a7cae88d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:58.598413 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c27b4848-ec0b-4d7c-b89f-de21a7cae88d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:58.598952 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c27b4848-ec0b-4d7c-b89f-de21a7cae88d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:58.599490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c27b4848-ec0b-4d7c-b89f-de21a7cae88d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:58.741799 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c27b4848-ec0b-4d7c-b89f-de21a7cae88d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:58.749631 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c27b4848-ec0b-4d7c-b89f-de21a7cae88d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.165271 Aug 05 07:23:58.750274 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 485/955] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:58 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:23:59.124842 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-daf2392f-8e43-4cf1-9642-36a78d2f86ff tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:59.126588 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-daf2392f-8e43-4cf1-9642-36a78d2f86ff tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:59.135549 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-daf2392f-8e43-4cf1-9642-36a78d2f86ff tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:59.136187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-daf2392f-8e43-4cf1-9642-36a78d2f86ff tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:59.136872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-daf2392f-8e43-4cf1-9642-36a78d2f86ff tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:59.137639 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-daf2392f-8e43-4cf1-9642-36a78d2f86ff tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:59.138307 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-daf2392f-8e43-4cf1-9642-36a78d2f86ff tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:59.138505 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-daf2392f-8e43-4cf1-9642-36a78d2f86ff tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:59.168946 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c2789bb5-b2bb-454c-bba6-f1cf3ebfaa50 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4963dcb790>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:59.204231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c2789bb5-b2bb-454c-bba6-f1cf3ebfaa50 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c" status: 200 len: 287 microversion: 2.1 time: 0.039049 Aug 05 07:23:59.204836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 486/956] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 5 07:23:59 2022] GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:23:59.298343 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-daf2392f-8e43-4cf1-9642-36a78d2f86ff tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:59.311392 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-daf2392f-8e43-4cf1-9642-36a78d2f86ff tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:59.312925 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-daf2392f-8e43-4cf1-9642-36a78d2f86ff tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:59.314361 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-daf2392f-8e43-4cf1-9642-36a78d2f86ff tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.194723 Aug 05 07:23:59.314923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 471/957] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:23:59 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:23:59.774242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-efa9b3c1-edd9-4a59-8d64-610ad0398d7b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:23:59.774857 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-efa9b3c1-edd9-4a59-8d64-610ad0398d7b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:23:59.781565 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-efa9b3c1-edd9-4a59-8d64-610ad0398d7b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:59.782025 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-efa9b3c1-edd9-4a59-8d64-610ad0398d7b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:59.782485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-efa9b3c1-edd9-4a59-8d64-610ad0398d7b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:59.783171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-efa9b3c1-edd9-4a59-8d64-610ad0398d7b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:23:59.783620 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-efa9b3c1-edd9-4a59-8d64-610ad0398d7b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:23:59.784029 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-efa9b3c1-edd9-4a59-8d64-610ad0398d7b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:23:59.943997 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-efa9b3c1-edd9-4a59-8d64-610ad0398d7b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:23:59.954941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-efa9b3c1-edd9-4a59-8d64-610ad0398d7b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.184651 Aug 05 07:23:59.955888 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 487/958] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:23:59 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:00.217677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-813f6c1c-34cc-4e1f-9956-54068567e370 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f49705cf3a0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:00.251759 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-813f6c1c-34cc-4e1f-9956-54068567e370 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c" status: 200 len: 287 microversion: 2.1 time: 0.038176 Aug 05 07:24:00.252447 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 472/959] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 5 07:24:00 2022] GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:00.337730 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a16e3b53-072c-4dad-92a7-3d7f6485257f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:00.338373 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a16e3b53-072c-4dad-92a7-3d7f6485257f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:00.345310 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a16e3b53-072c-4dad-92a7-3d7f6485257f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:00.345798 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a16e3b53-072c-4dad-92a7-3d7f6485257f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:00.346221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a16e3b53-072c-4dad-92a7-3d7f6485257f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:00.346914 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a16e3b53-072c-4dad-92a7-3d7f6485257f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:00.347363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a16e3b53-072c-4dad-92a7-3d7f6485257f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:00.347780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a16e3b53-072c-4dad-92a7-3d7f6485257f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:00.493799 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a16e3b53-072c-4dad-92a7-3d7f6485257f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:00.506122 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a16e3b53-072c-4dad-92a7-3d7f6485257f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:00.507621 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a16e3b53-072c-4dad-92a7-3d7f6485257f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:00.508806 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a16e3b53-072c-4dad-92a7-3d7f6485257f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.175189 Aug 05 07:24:00.509760 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 488/960] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:00 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:00.976332 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7444d06f-8a52-480a-9411-6bd589ddab2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:00.977265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7444d06f-8a52-480a-9411-6bd589ddab2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:00.984468 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7444d06f-8a52-480a-9411-6bd589ddab2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:00.985314 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7444d06f-8a52-480a-9411-6bd589ddab2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:00.986090 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7444d06f-8a52-480a-9411-6bd589ddab2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:00.987404 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7444d06f-8a52-480a-9411-6bd589ddab2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:00.990652 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7444d06f-8a52-480a-9411-6bd589ddab2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:00.991420 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7444d06f-8a52-480a-9411-6bd589ddab2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:01.154857 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7444d06f-8a52-480a-9411-6bd589ddab2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:01.163977 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7444d06f-8a52-480a-9411-6bd589ddab2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.191812 Aug 05 07:24:01.166063 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 473/961] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:00 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:01.265214 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7a48a9e6-f4bf-4119-8e57-4b653f47e5d8 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4963f38ca0>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:01.313032 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7a48a9e6-f4bf-4119-8e57-4b653f47e5d8 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c" status: 200 len: 287 microversion: 2.1 time: 0.052252 Aug 05 07:24:01.314230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 489/962] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 5 07:24:01 2022] GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:01.532099 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a0544db3-18da-4167-8c46-3cab0aedf5cf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:01.533294 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a0544db3-18da-4167-8c46-3cab0aedf5cf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:01.540197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0544db3-18da-4167-8c46-3cab0aedf5cf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:01.540682 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0544db3-18da-4167-8c46-3cab0aedf5cf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:01.541140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0544db3-18da-4167-8c46-3cab0aedf5cf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:01.542149 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0544db3-18da-4167-8c46-3cab0aedf5cf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:01.542615 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0544db3-18da-4167-8c46-3cab0aedf5cf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:01.543037 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0544db3-18da-4167-8c46-3cab0aedf5cf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:01.697829 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0544db3-18da-4167-8c46-3cab0aedf5cf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:01.705925 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0544db3-18da-4167-8c46-3cab0aedf5cf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:01.707415 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0544db3-18da-4167-8c46-3cab0aedf5cf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:01.708687 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a0544db3-18da-4167-8c46-3cab0aedf5cf tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.180685 Aug 05 07:24:01.709268 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 474/963] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:01 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:02.187286 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-15e38c0a-d0fd-473a-a27e-27e5ae22dca0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:02.188020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-15e38c0a-d0fd-473a-a27e-27e5ae22dca0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:02.194611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15e38c0a-d0fd-473a-a27e-27e5ae22dca0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:02.195085 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15e38c0a-d0fd-473a-a27e-27e5ae22dca0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:02.195509 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15e38c0a-d0fd-473a-a27e-27e5ae22dca0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:02.196190 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15e38c0a-d0fd-473a-a27e-27e5ae22dca0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:02.196632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15e38c0a-d0fd-473a-a27e-27e5ae22dca0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:02.197087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15e38c0a-d0fd-473a-a27e-27e5ae22dca0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:02.326677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-070c1f49-b860-42aa-bd33-bb7052fe573f tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f49705cfdc0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:02.356443 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-070c1f49-b860-42aa-bd33-bb7052fe573f tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c" status: 200 len: 288 microversion: 2.1 time: 0.033836 Aug 05 07:24:02.357201 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 475/964] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 5 07:24:02 2022] GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:24:02.366656 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-15e38c0a-d0fd-473a-a27e-27e5ae22dca0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:02.367847 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5586bdf2-3a6a-461c-86e4-257cfd79fb52 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f49705764c0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:02.375151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-15e38c0a-d0fd-473a-a27e-27e5ae22dca0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.191819 Aug 05 07:24:02.375151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 490/965] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:02 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:02.433939 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5586bdf2-3a6a-461c-86e4-257cfd79fb52 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c" status: 202 len: 0 microversion: 2.1 time: 0.069818 Aug 05 07:24:02.434562 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 476/966] 10.222.0.27 () {58 vars in 1254 bytes} [Fri Aug 5 07:24:02 2022] DELETE /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 07:24:02.444206 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ab316718-a09f-4219-bd24-62369e9f7093 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4963e07ee0>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:02.480279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ab316718-a09f-4219-bd24-62369e9f7093 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c" status: 200 len: 287 microversion: 2.1 time: 0.040985 Aug 05 07:24:02.480861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 491/967] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 5 07:24:02 2022] GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:02.735106 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d33892ed-4690-4790-b174-87ce26e26d97 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:02.736976 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d33892ed-4690-4790-b174-87ce26e26d97 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:02.748156 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d33892ed-4690-4790-b174-87ce26e26d97 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:02.749147 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d33892ed-4690-4790-b174-87ce26e26d97 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:02.750183 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d33892ed-4690-4790-b174-87ce26e26d97 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:02.751600 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d33892ed-4690-4790-b174-87ce26e26d97 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:02.752936 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d33892ed-4690-4790-b174-87ce26e26d97 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:02.753782 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d33892ed-4690-4790-b174-87ce26e26d97 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:02.924480 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d33892ed-4690-4790-b174-87ce26e26d97 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:02.934364 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d33892ed-4690-4790-b174-87ce26e26d97 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:02.935865 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d33892ed-4690-4790-b174-87ce26e26d97 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:02.937114 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d33892ed-4690-4790-b174-87ce26e26d97 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.208538 Aug 05 07:24:02.937933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 477/968] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:02 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:03.396509 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d20bfb4a-26a6-46fe-8854-e3a117302f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:03.397571 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d20bfb4a-26a6-46fe-8854-e3a117302f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:03.405165 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d20bfb4a-26a6-46fe-8854-e3a117302f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:03.405673 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d20bfb4a-26a6-46fe-8854-e3a117302f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:03.406109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d20bfb4a-26a6-46fe-8854-e3a117302f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:03.406828 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d20bfb4a-26a6-46fe-8854-e3a117302f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:03.407280 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d20bfb4a-26a6-46fe-8854-e3a117302f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:03.407710 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d20bfb4a-26a6-46fe-8854-e3a117302f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:03.493714 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-baecac9a-9a6a-41e0-9b22-e4406b734861 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f49705cfdc0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:03.568626 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-baecac9a-9a6a-41e0-9b22-e4406b734861 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] HTTP exception thrown: Snapshot ebfbac24-98d4-45db-b81e-2fb9f45ad99c could not be found. Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-baecac9a-9a6a-41e0-9b22-e4406b734861 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Request method failure captured: Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c HTTP/1.1 Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MWI8FG_LaPUTHyZhaRwbOCE2Qu7vtb3BSFvNQRy3hHRXA1wlOjvdqO3HvdILziJ_OjCby3ZO50PA1Q95szFIUbMp8Q3JL21MBVMhfRfU4W76bZAh4umUswH32RHwysfTXrnoueLUhPOZ5Tg54m6WXuDcdu9qGZRs9aK63d3FLbXyy8 Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: bf49b3f9c17a4a15bb2392edbab6d3cc Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1394199350 Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:24:03.571036 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf49b3f9c17a4a15bb2392edbab6d3cc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf49b3f9c17a4a15bb2392edbab6d3cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf49b3f9c17a4a15bb2392edbab6d3cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf49b3f9c17a4a15bb2392edbab6d3cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1394199350 Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: bf49b3f9c17a4a15bb2392edbab6d3cc Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1394199350 Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesSnapshotsTestJSON-1394199350-project Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 642019ed21ca4864a413989fee03dc49 Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1394199350-project Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Snapshot ebfbac24-98d4-45db-b81e-2fb9f45ad99c could not be found. Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'ebfbac24-98d4-45db-b81e-2fb9f45ad99c'} Aug 05 07:24:03.572754 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ebfbac24-98d4-45db-b81e-2fb9f45ad99c could not be found. (HTTP 404) (Request-ID: req-480e96e0-6487-48fa-ab8e-43b81dfea978) Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:03.573983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 07:24:03.575870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ebfbac24-98d4-45db-b81e-2fb9f45ad99c could not be found. Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 05 07:24:03.577402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:03.579018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ebfbac24-98d4-45db-b81e-2fb9f45ad99c could not be found. Aug 05 07:24:03.579018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:03.579018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:03.579018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:03.579018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:03.579018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:03.579018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:03.579018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:03.579018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:03.579018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ebfbac24-98d4-45db-b81e-2fb9f45ad99c could not be found. Aug 05 07:24:03.579018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:03.581403 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-baecac9a-9a6a-41e0-9b22-e4406b734861 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Returning 404 to user: Snapshot ebfbac24-98d4-45db-b81e-2fb9f45ad99c could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:03.582133 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-baecac9a-9a6a-41e0-9b22-e4406b734861 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c" status: 404 len: 111 microversion: 2.1 time: 0.092895 Aug 05 07:24:03.582715 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 478/969] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 5 07:24:03 2022] GET /compute/v2.1/os-snapshots/ebfbac24-98d4-45db-b81e-2fb9f45ad99c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 07:24:03.585859 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d20bfb4a-26a6-46fe-8854-e3a117302f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:03.592017 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f573763c-b2df-44ff-b5c3-e348e34d9f00 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4970715700>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:03.595351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d20bfb4a-26a6-46fe-8854-e3a117302f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.203237 Aug 05 07:24:03.596418 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 492/970] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:03 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:03.677566 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f573763c-b2df-44ff-b5c3-e348e34d9f00 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1" status: 202 len: 0 microversion: 2.1 time: 0.089431 Aug 05 07:24:03.678170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 479/971] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 5 07:24:03 2022] DELETE /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:24:03.687545 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-2d2ff336-ecd2-4c71-ae52-db248e9dadb4 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4963deaa60>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:03.747871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-2d2ff336-ecd2-4c71-ae52-db248e9dadb4 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1" status: 200 len: 345 microversion: 2.1 time: 0.064963 Aug 05 07:24:03.748497 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 493/972] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:24:03 2022] GET /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:03.960663 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1524a71c-9387-43b5-b481-230256ca4acb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:03.961368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1524a71c-9387-43b5-b481-230256ca4acb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:03.968609 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1524a71c-9387-43b5-b481-230256ca4acb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:03.969291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1524a71c-9387-43b5-b481-230256ca4acb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:03.969729 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1524a71c-9387-43b5-b481-230256ca4acb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:03.970489 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1524a71c-9387-43b5-b481-230256ca4acb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:03.971089 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1524a71c-9387-43b5-b481-230256ca4acb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:03.971527 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1524a71c-9387-43b5-b481-230256ca4acb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:04.128716 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1524a71c-9387-43b5-b481-230256ca4acb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:04.137585 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1524a71c-9387-43b5-b481-230256ca4acb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:04.139064 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1524a71c-9387-43b5-b481-230256ca4acb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:04.140210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1524a71c-9387-43b5-b481-230256ca4acb tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.184303 Aug 05 07:24:04.140765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 480/973] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:03 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:04.616328 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d09d07c4-ed02-4c75-a471-7655be23fc5c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:04.617196 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d09d07c4-ed02-4c75-a471-7655be23fc5c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:04.628808 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d09d07c4-ed02-4c75-a471-7655be23fc5c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:04.629423 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d09d07c4-ed02-4c75-a471-7655be23fc5c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:04.629942 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d09d07c4-ed02-4c75-a471-7655be23fc5c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:04.633666 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d09d07c4-ed02-4c75-a471-7655be23fc5c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:04.634579 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d09d07c4-ed02-4c75-a471-7655be23fc5c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:04.635224 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d09d07c4-ed02-4c75-a471-7655be23fc5c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:04.762906 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4f22dc47-cf10-4ca7-9a4c-ee0c4a2135d4 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4970576dc0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:04.778354 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d09d07c4-ed02-4c75-a471-7655be23fc5c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:04.794143 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d09d07c4-ed02-4c75-a471-7655be23fc5c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.182159 Aug 05 07:24:04.807148 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 494/974] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:04 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:04.811289 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-4f22dc47-cf10-4ca7-9a4c-ee0c4a2135d4 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] HTTP exception thrown: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4f22dc47-cf10-4ca7-9a4c-ee0c4a2135d4 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Request method failure captured: Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1 HTTP/1.1 Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MWI8FG_LaPUTHyZhaRwbOCE2Qu7vtb3BSFvNQRy3hHRXA1wlOjvdqO3HvdILziJ_OjCby3ZO50PA1Q95szFIUbMp8Q3JL21MBVMhfRfU4W76bZAh4umUswH32RHwysfTXrnoueLUhPOZ5Tg54m6WXuDcdu9qGZRs9aK63d3FLbXyy8 Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: bf49b3f9c17a4a15bb2392edbab6d3cc Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1394199350 Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:24:04.813802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf49b3f9c17a4a15bb2392edbab6d3cc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf49b3f9c17a4a15bb2392edbab6d3cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf49b3f9c17a4a15bb2392edbab6d3cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf49b3f9c17a4a15bb2392edbab6d3cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1394199350 Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: bf49b3f9c17a4a15bb2392edbab6d3cc Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1394199350 Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesSnapshotsTestJSON-1394199350-project Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 642019ed21ca4864a413989fee03dc49 Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1394199350-project Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'f8466518-76d2-4523-853d-7ddc6e8d07c1'} Aug 05 07:24:04.815706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. (HTTP 404) (Request-ID: req-2e50f6c2-a294-473c-9cd6-d2fbce0b1a9e) Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:04.817339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 07:24:04.818813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 07:24:04.820254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4f22dc47-cf10-4ca7-9a4c-ee0c4a2135d4 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Returning 404 to user: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4f22dc47-cf10-4ca7-9a4c-ee0c4a2135d4 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1" status: 404 len: 109 microversion: 2.1 time: 0.056863 Aug 05 07:24:04.822265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 481/975] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:24:04 2022] GET /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:04.826688 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0efb398a-3c57-444d-9800-eb0369657c7e tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f4963dea700>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:04.855480 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-0efb398a-3c57-444d-9800-eb0369657c7e tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] HTTP exception thrown: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0efb398a-3c57-444d-9800-eb0369657c7e tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Request method failure captured: Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: DELETE /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1 HTTP/1.1 Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MWI8FG_LaPUTHyZhaRwbOCE2Qu7vtb3BSFvNQRy3hHRXA1wlOjvdqO3HvdILziJ_OjCby3ZO50PA1Q95szFIUbMp8Q3JL21MBVMhfRfU4W76bZAh4umUswH32RHwysfTXrnoueLUhPOZ5Tg54m6WXuDcdu9qGZRs9aK63d3FLbXyy8 Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: bf49b3f9c17a4a15bb2392edbab6d3cc Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1394199350 Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:24:04.857712 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf49b3f9c17a4a15bb2392edbab6d3cc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf49b3f9c17a4a15bb2392edbab6d3cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf49b3f9c17a4a15bb2392edbab6d3cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf49b3f9c17a4a15bb2392edbab6d3cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1394199350 Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: bf49b3f9c17a4a15bb2392edbab6d3cc Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1394199350 Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-VolumesSnapshotsTestJSON-1394199350-project Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 642019ed21ca4864a413989fee03dc49 Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1394199350-project Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'f8466518-76d2-4523-853d-7ddc6e8d07c1'} Aug 05 07:24:04.859355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. (HTTP 404) (Request-ID: req-75d07739-4180-4822-a21e-c43167a6a574) Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:04.860634 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 07:24:04.862159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 07:24:04.863665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0efb398a-3c57-444d-9800-eb0369657c7e tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Returning 404 to user: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0efb398a-3c57-444d-9800-eb0369657c7e tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1" status: 404 len: 109 microversion: 2.1 time: 0.036470 Aug 05 07:24:04.865136 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 495/976] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Aug 5 07:24:04 2022] DELETE /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:04.867738 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-90f174a8-6523-402a-8da5-7733dd8009f5 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Calling method '.version_select at 0x7f49706f9550>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:04.897081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-90f174a8-6523-402a-8da5-7733dd8009f5 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] HTTP exception thrown: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-90f174a8-6523-402a-8da5-7733dd8009f5 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Request method failure captured: Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1 HTTP/1.1 Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MWI8FG_LaPUTHyZhaRwbOCE2Qu7vtb3BSFvNQRy3hHRXA1wlOjvdqO3HvdILziJ_OjCby3ZO50PA1Q95szFIUbMp8Q3JL21MBVMhfRfU4W76bZAh4umUswH32RHwysfTXrnoueLUhPOZ5Tg54m6WXuDcdu9qGZRs9aK63d3FLbXyy8 Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: bf49b3f9c17a4a15bb2392edbab6d3cc Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1394199350 Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:24:04.899035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf49b3f9c17a4a15bb2392edbab6d3cc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf49b3f9c17a4a15bb2392edbab6d3cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf49b3f9c17a4a15bb2392edbab6d3cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf49b3f9c17a4a15bb2392edbab6d3cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1394199350 Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: bf49b3f9c17a4a15bb2392edbab6d3cc Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1394199350 Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesSnapshotsTestJSON-1394199350-project Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 642019ed21ca4864a413989fee03dc49 Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1394199350-project Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'f8466518-76d2-4523-853d-7ddc6e8d07c1'} Aug 05 07:24:04.900394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. (HTTP 404) (Request-ID: req-7b39861d-0ac4-43b9-863b-37136a5dce09) Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:04.901670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 07:24:04.903169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 07:24:04.905032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-90f174a8-6523-402a-8da5-7733dd8009f5 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] Returning 404 to user: Volume f8466518-76d2-4523-853d-7ddc6e8d07c1 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-90f174a8-6523-402a-8da5-7733dd8009f5 tempest-VolumesSnapshotsTestJSON-1394199350 tempest-VolumesSnapshotsTestJSON-1394199350-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1" status: 404 len: 109 microversion: 2.1 time: 0.036563 Aug 05 07:24:04.906491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 482/977] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:24:04 2022] GET /compute/v2.1/os-volumes/f8466518-76d2-4523-853d-7ddc6e8d07c1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:05.165941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b0f170de-cc0f-44ec-be2c-926548e237a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:05.166564 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b0f170de-cc0f-44ec-be2c-926548e237a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:05.182956 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b0f170de-cc0f-44ec-be2c-926548e237a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:05.183472 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b0f170de-cc0f-44ec-be2c-926548e237a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:05.183892 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b0f170de-cc0f-44ec-be2c-926548e237a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:05.184605 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b0f170de-cc0f-44ec-be2c-926548e237a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:05.185248 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b0f170de-cc0f-44ec-be2c-926548e237a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:05.185687 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b0f170de-cc0f-44ec-be2c-926548e237a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:05.363470 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b0f170de-cc0f-44ec-be2c-926548e237a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:05.377127 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b0f170de-cc0f-44ec-be2c-926548e237a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:05.378771 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b0f170de-cc0f-44ec-be2c-926548e237a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:05.380198 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b0f170de-cc0f-44ec-be2c-926548e237a2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.220414 Aug 05 07:24:05.380853 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 496/978] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:05 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:05.816725 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eca90c10-0325-43bb-8876-db29a9a5cbb8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:05.818850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-eca90c10-0325-43bb-8876-db29a9a5cbb8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:05.826051 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eca90c10-0325-43bb-8876-db29a9a5cbb8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:05.826833 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eca90c10-0325-43bb-8876-db29a9a5cbb8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:05.827458 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eca90c10-0325-43bb-8876-db29a9a5cbb8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:05.828178 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eca90c10-0325-43bb-8876-db29a9a5cbb8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:05.828758 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eca90c10-0325-43bb-8876-db29a9a5cbb8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:05.829548 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eca90c10-0325-43bb-8876-db29a9a5cbb8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:05.976053 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-eca90c10-0325-43bb-8876-db29a9a5cbb8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:05.984394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-eca90c10-0325-43bb-8876-db29a9a5cbb8 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.173275 Aug 05 07:24:05.985380 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 483/979] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:05 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:06.405023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b24ed853-1646-4a46-a8df-7e3093584285 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:06.405654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b24ed853-1646-4a46-a8df-7e3093584285 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:06.413272 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b24ed853-1646-4a46-a8df-7e3093584285 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:06.413895 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b24ed853-1646-4a46-a8df-7e3093584285 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:06.414331 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b24ed853-1646-4a46-a8df-7e3093584285 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:06.415273 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b24ed853-1646-4a46-a8df-7e3093584285 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:06.415728 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b24ed853-1646-4a46-a8df-7e3093584285 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:06.416148 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b24ed853-1646-4a46-a8df-7e3093584285 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:06.626475 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b24ed853-1646-4a46-a8df-7e3093584285 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:06.636660 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b24ed853-1646-4a46-a8df-7e3093584285 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:06.638476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b24ed853-1646-4a46-a8df-7e3093584285 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:06.639924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b24ed853-1646-4a46-a8df-7e3093584285 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.240453 Aug 05 07:24:06.655545 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 497/980] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:06 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:07.004784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-adcd472a-0e54-49da-b8a3-bfd06d31fec5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:07.005445 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-adcd472a-0e54-49da-b8a3-bfd06d31fec5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:07.012400 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-adcd472a-0e54-49da-b8a3-bfd06d31fec5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:07.012930 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-adcd472a-0e54-49da-b8a3-bfd06d31fec5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:07.013460 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-adcd472a-0e54-49da-b8a3-bfd06d31fec5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:07.014151 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-adcd472a-0e54-49da-b8a3-bfd06d31fec5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:07.014593 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-adcd472a-0e54-49da-b8a3-bfd06d31fec5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:07.015009 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-adcd472a-0e54-49da-b8a3-bfd06d31fec5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:07.166859 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-adcd472a-0e54-49da-b8a3-bfd06d31fec5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:07.174461 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-adcd472a-0e54-49da-b8a3-bfd06d31fec5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.173595 Aug 05 07:24:07.175028 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 484/981] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:06 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:07.664240 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ed12e359-533d-4c52-95b4-b31e988062dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:07.665976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ed12e359-533d-4c52-95b4-b31e988062dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:07.674132 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ed12e359-533d-4c52-95b4-b31e988062dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:07.674984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ed12e359-533d-4c52-95b4-b31e988062dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:07.675998 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ed12e359-533d-4c52-95b4-b31e988062dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:07.677070 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ed12e359-533d-4c52-95b4-b31e988062dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:07.677795 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ed12e359-533d-4c52-95b4-b31e988062dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:07.678474 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ed12e359-533d-4c52-95b4-b31e988062dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:07.826511 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ed12e359-533d-4c52-95b4-b31e988062dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:07.835092 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ed12e359-533d-4c52-95b4-b31e988062dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:07.836583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ed12e359-533d-4c52-95b4-b31e988062dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:07.837783 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ed12e359-533d-4c52-95b4-b31e988062dd tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.178803 Aug 05 07:24:07.838336 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 498/982] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:07 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:08.195801 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a7b16604-ba2f-4aa9-bc2a-c8fd75a2b19a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:08.197105 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a7b16604-ba2f-4aa9-bc2a-c8fd75a2b19a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:08.203838 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7b16604-ba2f-4aa9-bc2a-c8fd75a2b19a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:08.204251 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7b16604-ba2f-4aa9-bc2a-c8fd75a2b19a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:08.204727 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7b16604-ba2f-4aa9-bc2a-c8fd75a2b19a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:08.205881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7b16604-ba2f-4aa9-bc2a-c8fd75a2b19a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:08.206657 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7b16604-ba2f-4aa9-bc2a-c8fd75a2b19a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:08.207345 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7b16604-ba2f-4aa9-bc2a-c8fd75a2b19a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:08.355674 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a7b16604-ba2f-4aa9-bc2a-c8fd75a2b19a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:08.365966 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a7b16604-ba2f-4aa9-bc2a-c8fd75a2b19a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.174176 Aug 05 07:24:08.366434 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 485/983] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:08 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:08.860118 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-10d41459-35e0-4459-95a9-3b67a6a494f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:08.860716 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-10d41459-35e0-4459-95a9-3b67a6a494f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:08.867863 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10d41459-35e0-4459-95a9-3b67a6a494f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:08.868347 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10d41459-35e0-4459-95a9-3b67a6a494f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:08.868783 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10d41459-35e0-4459-95a9-3b67a6a494f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:08.869533 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10d41459-35e0-4459-95a9-3b67a6a494f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:08.870009 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10d41459-35e0-4459-95a9-3b67a6a494f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:08.870434 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-10d41459-35e0-4459-95a9-3b67a6a494f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:09.007346 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-10d41459-35e0-4459-95a9-3b67a6a494f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:09.019208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-10d41459-35e0-4459-95a9-3b67a6a494f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:09.020743 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-10d41459-35e0-4459-95a9-3b67a6a494f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:09.022104 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-10d41459-35e0-4459-95a9-3b67a6a494f7 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.166123 Aug 05 07:24:09.026759 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 499/984] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:08 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:09.099167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e2b50ca8-abd5-46cb-b329-f2b5b7d17dad tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] Calling method '.version_select at 0x7f4970549940>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:09.156815 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e2b50ca8-abd5-46cb-b329-f2b5b7d17dad tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8ecd1504-2b92-40c7-985f-6f4988bb6ab6" status: 200 len: 349 microversion: 2.1 time: 0.061535 Aug 05 07:24:09.157422 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 486/985] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:24:09 2022] GET /compute/v2.1/os-volumes/8ecd1504-2b92-40c7-985f-6f4988bb6ab6 => generated 349 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:09.387049 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-516a547b-525d-4e34-8ca2-8cfef191bde0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:09.387701 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-516a547b-525d-4e34-8ca2-8cfef191bde0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:09.394148 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-516a547b-525d-4e34-8ca2-8cfef191bde0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:09.394908 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-516a547b-525d-4e34-8ca2-8cfef191bde0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:09.395336 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-516a547b-525d-4e34-8ca2-8cfef191bde0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:09.396618 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-516a547b-525d-4e34-8ca2-8cfef191bde0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:09.397320 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-516a547b-525d-4e34-8ca2-8cfef191bde0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:09.398034 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-516a547b-525d-4e34-8ca2-8cfef191bde0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:09.546676 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-516a547b-525d-4e34-8ca2-8cfef191bde0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:09.554770 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-516a547b-525d-4e34-8ca2-8cfef191bde0 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.172525 Aug 05 07:24:09.555362 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 500/986] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:09 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:10.058806 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-580bd438-c3fc-4f32-af03-799165b74e54 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:10.059396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-580bd438-c3fc-4f32-af03-799165b74e54 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:10.066081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-580bd438-c3fc-4f32-af03-799165b74e54 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:10.066715 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-580bd438-c3fc-4f32-af03-799165b74e54 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:10.067147 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-580bd438-c3fc-4f32-af03-799165b74e54 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:10.067833 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-580bd438-c3fc-4f32-af03-799165b74e54 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:10.068393 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-580bd438-c3fc-4f32-af03-799165b74e54 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:10.068812 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-580bd438-c3fc-4f32-af03-799165b74e54 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:10.216721 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-580bd438-c3fc-4f32-af03-799165b74e54 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:10.226325 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-580bd438-c3fc-4f32-af03-799165b74e54 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:10.227794 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-580bd438-c3fc-4f32-af03-799165b74e54 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:10.229009 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-580bd438-c3fc-4f32-af03-799165b74e54 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.175141 Aug 05 07:24:10.229569 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 487/987] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:10 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:10.577183 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-994df3bb-f905-4b3c-9a25-8c9765b74061 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:10.577809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-994df3bb-f905-4b3c-9a25-8c9765b74061 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:10.584745 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-994df3bb-f905-4b3c-9a25-8c9765b74061 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:10.585256 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-994df3bb-f905-4b3c-9a25-8c9765b74061 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:10.585688 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-994df3bb-f905-4b3c-9a25-8c9765b74061 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:10.586387 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-994df3bb-f905-4b3c-9a25-8c9765b74061 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:10.586836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-994df3bb-f905-4b3c-9a25-8c9765b74061 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:10.587254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-994df3bb-f905-4b3c-9a25-8c9765b74061 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:10.731715 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-994df3bb-f905-4b3c-9a25-8c9765b74061 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:10.739259 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-994df3bb-f905-4b3c-9a25-8c9765b74061 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.166244 Aug 05 07:24:10.739918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 501/988] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:10 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:11.253105 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c4902b66-398f-4080-a5bf-797ba2a676f2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:11.253651 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c4902b66-398f-4080-a5bf-797ba2a676f2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:11.261330 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4902b66-398f-4080-a5bf-797ba2a676f2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:11.261824 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4902b66-398f-4080-a5bf-797ba2a676f2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:11.262434 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4902b66-398f-4080-a5bf-797ba2a676f2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:11.263201 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4902b66-398f-4080-a5bf-797ba2a676f2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:11.263650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4902b66-398f-4080-a5bf-797ba2a676f2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:11.264075 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4902b66-398f-4080-a5bf-797ba2a676f2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:11.409204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c4902b66-398f-4080-a5bf-797ba2a676f2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:11.417619 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c4902b66-398f-4080-a5bf-797ba2a676f2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:11.419137 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c4902b66-398f-4080-a5bf-797ba2a676f2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:11.420310 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c4902b66-398f-4080-a5bf-797ba2a676f2 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.171661 Aug 05 07:24:11.420879 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 488/989] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:11 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:11.590435 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0ac025a9-f139-4ea4-aab7-d0ee67477476 tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] Calling method '.version_select at 0x7f4963e7c9d0>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:11.642653 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0ac025a9-f139-4ea4-aab7-d0ee67477476 tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/48a33700-aaa0-4db4-bc77-6cb47b771264" status: 200 len: 350 microversion: 2.1 time: 0.058011 Aug 05 07:24:11.643228 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 502/990] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:24:11 2022] GET /compute/v2.1/os-volumes/48a33700-aaa0-4db4-bc77-6cb47b771264 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:11.767034 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-895bca71-fd04-4c9c-81d7-3ec0b5bb6d11 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:11.767635 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-895bca71-fd04-4c9c-81d7-3ec0b5bb6d11 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:11.775747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-895bca71-fd04-4c9c-81d7-3ec0b5bb6d11 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:11.776283 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-895bca71-fd04-4c9c-81d7-3ec0b5bb6d11 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:11.776644 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-895bca71-fd04-4c9c-81d7-3ec0b5bb6d11 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:11.777375 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-895bca71-fd04-4c9c-81d7-3ec0b5bb6d11 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:11.777804 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-895bca71-fd04-4c9c-81d7-3ec0b5bb6d11 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:11.778219 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-895bca71-fd04-4c9c-81d7-3ec0b5bb6d11 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:11.941016 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-895bca71-fd04-4c9c-81d7-3ec0b5bb6d11 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:11.949635 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-895bca71-fd04-4c9c-81d7-3ec0b5bb6d11 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.186437 Aug 05 07:24:11.950210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 489/991] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:11 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:12.446681 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7d874f8a-0884-4bf4-9a88-55b685258837 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:12.447278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7d874f8a-0884-4bf4-9a88-55b685258837 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:12.453996 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d874f8a-0884-4bf4-9a88-55b685258837 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:12.454498 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d874f8a-0884-4bf4-9a88-55b685258837 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:12.454939 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d874f8a-0884-4bf4-9a88-55b685258837 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:12.455670 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d874f8a-0884-4bf4-9a88-55b685258837 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:12.456130 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d874f8a-0884-4bf4-9a88-55b685258837 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:12.456551 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7d874f8a-0884-4bf4-9a88-55b685258837 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:12.461991 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:12.616082 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7d874f8a-0884-4bf4-9a88-55b685258837 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:12.625059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7d874f8a-0884-4bf4-9a88-55b685258837 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:12.626483 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7d874f8a-0884-4bf4-9a88-55b685258837 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:12.627681 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7d874f8a-0884-4bf4-9a88-55b685258837 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.185276 Aug 05 07:24:12.628248 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 503/992] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:12 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:12.972208 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-da4e7326-7a8e-489a-a9bb-d7f304feeeb2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:12.973221 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-da4e7326-7a8e-489a-a9bb-d7f304feeeb2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:12.981072 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-da4e7326-7a8e-489a-a9bb-d7f304feeeb2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:12.981565 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-da4e7326-7a8e-489a-a9bb-d7f304feeeb2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:12.981994 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-da4e7326-7a8e-489a-a9bb-d7f304feeeb2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:12.982703 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-da4e7326-7a8e-489a-a9bb-d7f304feeeb2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:12.983149 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-da4e7326-7a8e-489a-a9bb-d7f304feeeb2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:12.983560 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-da4e7326-7a8e-489a-a9bb-d7f304feeeb2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:13.031926 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d1bd1319-4167-47b8-a015-6064f20a2eea tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] Calling method '.version_select at 0x7f4963e6c0d0>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:13.100393 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d1bd1319-4167-47b8-a015-6064f20a2eea tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/242a45d3-f855-4eea-9802-be896f36d0ed" status: 200 len: 351 microversion: 2.1 time: 0.077185 Aug 05 07:24:13.101279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 504/993] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Aug 5 07:24:13 2022] GET /compute/v2.1/os-volumes/242a45d3-f855-4eea-9802-be896f36d0ed => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:13.114847 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-372badd0-8652-4ccd-918d-94b364824c0d tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] Calling method '.version_select at 0x7f4963e07940>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:13.154747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-da4e7326-7a8e-489a-a9bb-d7f304feeeb2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:13.162488 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-da4e7326-7a8e-489a-a9bb-d7f304feeeb2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.195293 Aug 05 07:24:13.163069 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 490/994] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:12 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:13.252608 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-372badd0-8652-4ccd-918d-94b364824c0d tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.142529 Aug 05 07:24:13.253215 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 505/995] 10.222.0.27 () {58 vars in 1134 bytes} [Fri Aug 5 07:24:13 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:24:13.268710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c4e138b1-d4ef-48b0-88c8-42a0f2cb3a4d tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] Calling method '.version_select at 0x7f49706191f0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:13.357307 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c4e138b1-d4ef-48b0-88c8-42a0f2cb3a4d tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091948 Aug 05 07:24:13.358311 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 491/996] 10.222.0.27 () {58 vars in 1149 bytes} [Fri Aug 5 07:24:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:24:13.372050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7c489d2b-6450-4767-a0f3-e584ccd69f12 tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] Calling method '.version_select at 0x7f4963dea670>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:13.475829 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7c489d2b-6450-4767-a0f3-e584ccd69f12 tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.107804 Aug 05 07:24:13.476528 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 506/997] 10.222.0.27 () {58 vars in 1134 bytes} [Fri Aug 5 07:24:13 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:13.490097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d6eccd4e-ac5d-420e-abc3-b1fba9045f0a tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] Calling method '.version_select at 0x7f49707843a0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:13.581170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d6eccd4e-ac5d-420e-abc3-b1fba9045f0a tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.095079 Aug 05 07:24:13.581895 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 492/998] 10.222.0.27 () {58 vars in 1167 bytes} [Fri Aug 5 07:24:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:13.597821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-01221078-caf2-43e4-88a9-41e7d0b9eea8 tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] Calling method '.version_select at 0x7f4963e3a940>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:13.663399 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-86e1af94-7eb8-4406-a937-fc7b3db87c00 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:13.667161 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-86e1af94-7eb8-4406-a937-fc7b3db87c00 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:13.697809 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86e1af94-7eb8-4406-a937-fc7b3db87c00 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:13.699097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86e1af94-7eb8-4406-a937-fc7b3db87c00 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:13.700043 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86e1af94-7eb8-4406-a937-fc7b3db87c00 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:13.701511 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86e1af94-7eb8-4406-a937-fc7b3db87c00 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:13.707295 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86e1af94-7eb8-4406-a937-fc7b3db87c00 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:13.708256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86e1af94-7eb8-4406-a937-fc7b3db87c00 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:13.737019 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-01221078-caf2-43e4-88a9-41e7d0b9eea8 tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.144642 Aug 05 07:24:13.738013 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 507/999] 10.222.0.27 () {58 vars in 1170 bytes} [Fri Aug 5 07:24:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:13.745216 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:13.763540 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-eff5fa91-e39e-449f-aefa-6394ec558c8c tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] Calling method '.version_select at 0x7f49747c9280>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:13.896212 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-eff5fa91-e39e-449f-aefa-6394ec558c8c tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.138245 Aug 05 07:24:13.896810 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 508/1000] 10.222.0.27 () {58 vars in 1155 bytes} [Fri Aug 5 07:24:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:24:13.918373 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-cc1d8a36-3dd7-41a2-a4a3-6badae74a2dd tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] Calling method '.version_select at 0x7f4963e7c1f0>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:13.965631 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-86e1af94-7eb8-4406-a937-fc7b3db87c00 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:13.975400 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-86e1af94-7eb8-4406-a937-fc7b3db87c00 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:13.977157 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-86e1af94-7eb8-4406-a937-fc7b3db87c00 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:13.978480 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-86e1af94-7eb8-4406-a937-fc7b3db87c00 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.330217 Aug 05 07:24:13.979140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 493/1001] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:13 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:24:14.041485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-cc1d8a36-3dd7-41a2-a4a3-6badae74a2dd tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.129947 Aug 05 07:24:14.042054 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 509/1002] 10.222.0.27 () {58 vars in 1188 bytes} [Fri Aug 5 07:24:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:14.055388 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c60ce864-a331-4f04-bfc8-bc94864e1421 tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] Calling method '.version_select at 0x7f4970784040>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:14.140072 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c60ce864-a331-4f04-bfc8-bc94864e1421 tempest-VolumesTestJSON-1998564252 tempest-VolumesTestJSON-1998564252-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.088492 Aug 05 07:24:14.140692 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 494/1003] 10.222.0.27 () {58 vars in 1155 bytes} [Fri Aug 5 07:24:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:14.194487 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4e560615-74d9-4d43-b26e-632c7a866859 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:14.195711 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4e560615-74d9-4d43-b26e-632c7a866859 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:14.231994 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e560615-74d9-4d43-b26e-632c7a866859 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:14.232858 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e560615-74d9-4d43-b26e-632c7a866859 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:14.233819 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e560615-74d9-4d43-b26e-632c7a866859 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:14.235049 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e560615-74d9-4d43-b26e-632c7a866859 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:14.235798 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e560615-74d9-4d43-b26e-632c7a866859 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:14.236519 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e560615-74d9-4d43-b26e-632c7a866859 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:14.670250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-4e560615-74d9-4d43-b26e-632c7a866859 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:14.680629 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4e560615-74d9-4d43-b26e-632c7a866859 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1277 microversion: 2.1 time: 0.494049 Aug 05 07:24:14.681386 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 510/1004] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:14 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1277 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:15.017420 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e67d37be-c797-4269-a2ec-4d802ea17905 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:15.018040 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e67d37be-c797-4269-a2ec-4d802ea17905 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:15.025708 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e67d37be-c797-4269-a2ec-4d802ea17905 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:15.026200 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e67d37be-c797-4269-a2ec-4d802ea17905 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:15.026629 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e67d37be-c797-4269-a2ec-4d802ea17905 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:15.027398 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e67d37be-c797-4269-a2ec-4d802ea17905 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:15.027949 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e67d37be-c797-4269-a2ec-4d802ea17905 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:15.028570 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e67d37be-c797-4269-a2ec-4d802ea17905 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:15.207482 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e67d37be-c797-4269-a2ec-4d802ea17905 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:15.217126 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e67d37be-c797-4269-a2ec-4d802ea17905 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:15.219037 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e67d37be-c797-4269-a2ec-4d802ea17905 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:15.220616 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e67d37be-c797-4269-a2ec-4d802ea17905 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.207291 Aug 05 07:24:15.221589 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 495/1005] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:15 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:15.716887 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d9dd1519-c3a1-405e-8d68-1e8e9ffdf2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:15.718030 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d9dd1519-c3a1-405e-8d68-1e8e9ffdf2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:15.727740 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9dd1519-c3a1-405e-8d68-1e8e9ffdf2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:15.728688 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9dd1519-c3a1-405e-8d68-1e8e9ffdf2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:15.729714 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9dd1519-c3a1-405e-8d68-1e8e9ffdf2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:15.730996 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9dd1519-c3a1-405e-8d68-1e8e9ffdf2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:15.731600 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9dd1519-c3a1-405e-8d68-1e8e9ffdf2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:15.732221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d9dd1519-c3a1-405e-8d68-1e8e9ffdf2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:15.776182 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1d255c06-1505-4e2e-a28b-0375825a02b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:15.777130 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1d255c06-1505-4e2e-a28b-0375825a02b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:15.785135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d255c06-1505-4e2e-a28b-0375825a02b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:15.785768 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d255c06-1505-4e2e-a28b-0375825a02b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:15.786406 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d255c06-1505-4e2e-a28b-0375825a02b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:15.787383 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d255c06-1505-4e2e-a28b-0375825a02b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:15.788138 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d255c06-1505-4e2e-a28b-0375825a02b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:15.788739 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d255c06-1505-4e2e-a28b-0375825a02b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:15.890248 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-1d255c06-1505-4e2e-a28b-0375825a02b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lazy-loading 'services' on Instance uuid a3696e06-e4c3-4ec1-8066-c5d225e93178 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:24:15.920185 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d9dd1519-c3a1-405e-8d68-1e8e9ffdf2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:15.930071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d9dd1519-c3a1-405e-8d68-1e8e9ffdf2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.220417 Aug 05 07:24:15.932969 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 511/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:15 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:15.983273 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1d255c06-1505-4e2e-a28b-0375825a02b4 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-volume_attachments/62888255-1b03-4d79-8d61-37eba356fe43" status: 202 len: 0 microversion: 2.1 time: 0.210757 Aug 05 07:24:15.984035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 496/1007] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 5 07:24:15 2022] DELETE /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-volume_attachments/62888255-1b03-4d79-8d61-37eba356fe43 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 07:24:15.994343 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-47da956f-9251-4ee1-bb30-82603a956e18 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:15.996720 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-47da956f-9251-4ee1-bb30-82603a956e18 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:16.003450 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-47da956f-9251-4ee1-bb30-82603a956e18 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:16.004175 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-47da956f-9251-4ee1-bb30-82603a956e18 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:16.005147 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-47da956f-9251-4ee1-bb30-82603a956e18 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:16.006239 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-47da956f-9251-4ee1-bb30-82603a956e18 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:16.006933 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-47da956f-9251-4ee1-bb30-82603a956e18 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:16.007648 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-47da956f-9251-4ee1-bb30-82603a956e18 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:16.049134 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-47da956f-9251-4ee1-bb30-82603a956e18 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059198 Aug 05 07:24:16.050280 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 512/1008] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:24:15 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:16.245267 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ff87fb7e-60a5-486b-8bc0-b4c79551e280 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:16.246003 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ff87fb7e-60a5-486b-8bc0-b4c79551e280 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:16.253316 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ff87fb7e-60a5-486b-8bc0-b4c79551e280 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:16.253784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ff87fb7e-60a5-486b-8bc0-b4c79551e280 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:16.254217 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ff87fb7e-60a5-486b-8bc0-b4c79551e280 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:16.254923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ff87fb7e-60a5-486b-8bc0-b4c79551e280 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:16.255416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ff87fb7e-60a5-486b-8bc0-b4c79551e280 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:16.255886 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ff87fb7e-60a5-486b-8bc0-b4c79551e280 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:16.404053 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ff87fb7e-60a5-486b-8bc0-b4c79551e280 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:16.412839 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ff87fb7e-60a5-486b-8bc0-b4c79551e280 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:16.414400 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ff87fb7e-60a5-486b-8bc0-b4c79551e280 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:16.415609 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ff87fb7e-60a5-486b-8bc0-b4c79551e280 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.175335 Aug 05 07:24:16.416168 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 497/1009] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:16 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:16.951378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a23c45b0-1730-4c84-8656-ccbb549d7418 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:16.952106 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a23c45b0-1730-4c84-8656-ccbb549d7418 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:16.958853 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a23c45b0-1730-4c84-8656-ccbb549d7418 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:16.959332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a23c45b0-1730-4c84-8656-ccbb549d7418 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:16.959845 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a23c45b0-1730-4c84-8656-ccbb549d7418 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:16.960563 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a23c45b0-1730-4c84-8656-ccbb549d7418 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:16.961045 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a23c45b0-1730-4c84-8656-ccbb549d7418 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:16.961453 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a23c45b0-1730-4c84-8656-ccbb549d7418 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:17.062999 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-92b1ac75-0dbc-46be-b1ab-f508f0652ab8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:17.065510 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-92b1ac75-0dbc-46be-b1ab-f508f0652ab8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:17.072377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-92b1ac75-0dbc-46be-b1ab-f508f0652ab8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:17.072854 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-92b1ac75-0dbc-46be-b1ab-f508f0652ab8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:17.073323 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-92b1ac75-0dbc-46be-b1ab-f508f0652ab8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:17.074243 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-92b1ac75-0dbc-46be-b1ab-f508f0652ab8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:17.074731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-92b1ac75-0dbc-46be-b1ab-f508f0652ab8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:17.075134 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-92b1ac75-0dbc-46be-b1ab-f508f0652ab8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:17.112257 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-92b1ac75-0dbc-46be-b1ab-f508f0652ab8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053180 Aug 05 07:24:17.113130 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 498/1010] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:24:17 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:17.114318 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a23c45b0-1730-4c84-8656-ccbb549d7418 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:17.135776 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a23c45b0-1730-4c84-8656-ccbb549d7418 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.186985 Aug 05 07:24:17.149977 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 513/1011] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:16 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:17.316318 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-9ad6ba78-f4b2-4366-b502-dda28aa5b96a req-6072e4c0-7e27-41e4-ad12-502cb7ccee03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d197c94-dfa3-4fe2-974d-4134fb0cb595", "name": "network-vif-plugged", "status": "completed", "tag": "155ed77d-f493-45be-ad25-67f9052f1659"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:24:17.328814 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-9ad6ba78-f4b2-4366-b502-dda28aa5b96a req-6072e4c0-7e27-41e4-ad12-502cb7ccee03 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:17.329407 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-9ad6ba78-f4b2-4366-b502-dda28aa5b96a req-6072e4c0-7e27-41e4-ad12-502cb7ccee03 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:17.330077 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-9ad6ba78-f4b2-4366-b502-dda28aa5b96a req-6072e4c0-7e27-41e4-ad12-502cb7ccee03 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:17.343864 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-9ad6ba78-f4b2-4366-b502-dda28aa5b96a req-6072e4c0-7e27-41e4-ad12-502cb7ccee03 service nova] Creating event network-vif-plugged:155ed77d-f493-45be-ad25-67f9052f1659 for instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 on hv-cinder-85200 Aug 05 07:24:17.349793 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-9ad6ba78-f4b2-4366-b502-dda28aa5b96a req-6072e4c0-7e27-41e4-ad12-502cb7ccee03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036875 Aug 05 07:24:17.350019 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 499/1012] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:17.439068 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ab1c9cf6-fa56-4e69-8afb-0b0c0387860a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:17.439802 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ab1c9cf6-fa56-4e69-8afb-0b0c0387860a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:17.447359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ab1c9cf6-fa56-4e69-8afb-0b0c0387860a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:17.447947 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ab1c9cf6-fa56-4e69-8afb-0b0c0387860a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:17.448449 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ab1c9cf6-fa56-4e69-8afb-0b0c0387860a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:17.449327 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ab1c9cf6-fa56-4e69-8afb-0b0c0387860a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:17.449858 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ab1c9cf6-fa56-4e69-8afb-0b0c0387860a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:17.450299 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ab1c9cf6-fa56-4e69-8afb-0b0c0387860a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:17.613585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ab1c9cf6-fa56-4e69-8afb-0b0c0387860a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:17.622594 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ab1c9cf6-fa56-4e69-8afb-0b0c0387860a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:17.624116 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ab1c9cf6-fa56-4e69-8afb-0b0c0387860a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:17.625335 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ab1c9cf6-fa56-4e69-8afb-0b0c0387860a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.190552 Aug 05 07:24:17.625925 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 514/1013] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:17 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:18.131935 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-16c5369d-3b20-4db2-b7cd-429eaab19922 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:18.136270 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-16c5369d-3b20-4db2-b7cd-429eaab19922 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:18.147050 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16c5369d-3b20-4db2-b7cd-429eaab19922 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:18.147915 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16c5369d-3b20-4db2-b7cd-429eaab19922 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:18.148747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16c5369d-3b20-4db2-b7cd-429eaab19922 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:18.150053 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16c5369d-3b20-4db2-b7cd-429eaab19922 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:18.150902 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16c5369d-3b20-4db2-b7cd-429eaab19922 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:18.151599 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16c5369d-3b20-4db2-b7cd-429eaab19922 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:18.163696 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7afdf776-8f0f-4186-ba53-9faa9067ad0d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:18.164715 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7afdf776-8f0f-4186-ba53-9faa9067ad0d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:18.180817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7afdf776-8f0f-4186-ba53-9faa9067ad0d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:18.181929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7afdf776-8f0f-4186-ba53-9faa9067ad0d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:18.182478 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7afdf776-8f0f-4186-ba53-9faa9067ad0d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:18.190907 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7afdf776-8f0f-4186-ba53-9faa9067ad0d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:18.191571 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7afdf776-8f0f-4186-ba53-9faa9067ad0d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:18.192358 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7afdf776-8f0f-4186-ba53-9faa9067ad0d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:18.213484 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-16c5369d-3b20-4db2-b7cd-429eaab19922 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088960 Aug 05 07:24:18.214630 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 500/1014] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:24:18 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:18.361553 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7afdf776-8f0f-4186-ba53-9faa9067ad0d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:18.371941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7afdf776-8f0f-4186-ba53-9faa9067ad0d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.213482 Aug 05 07:24:18.374722 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 515/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:18 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:24:18.651376 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-28063c2b-df2f-48dc-aa7c-f0618c91982f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:18.652157 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-28063c2b-df2f-48dc-aa7c-f0618c91982f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:18.661766 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-28063c2b-df2f-48dc-aa7c-f0618c91982f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:18.662653 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-28063c2b-df2f-48dc-aa7c-f0618c91982f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:18.663413 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-28063c2b-df2f-48dc-aa7c-f0618c91982f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:18.665137 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-28063c2b-df2f-48dc-aa7c-f0618c91982f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:18.665991 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-28063c2b-df2f-48dc-aa7c-f0618c91982f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:18.666726 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-28063c2b-df2f-48dc-aa7c-f0618c91982f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:18.863540 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-28063c2b-df2f-48dc-aa7c-f0618c91982f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:18.876846 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-28063c2b-df2f-48dc-aa7c-f0618c91982f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:18.880088 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-28063c2b-df2f-48dc-aa7c-f0618c91982f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:18.882693 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-28063c2b-df2f-48dc-aa7c-f0618c91982f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.236715 Aug 05 07:24:18.895979 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 501/1016] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:18 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:19.226880 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7cb8e0c0-7dc5-44bb-bfb2-a9a9c881a855 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:19.229613 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7cb8e0c0-7dc5-44bb-bfb2-a9a9c881a855 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:19.236459 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7cb8e0c0-7dc5-44bb-bfb2-a9a9c881a855 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:19.236974 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7cb8e0c0-7dc5-44bb-bfb2-a9a9c881a855 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:19.237612 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7cb8e0c0-7dc5-44bb-bfb2-a9a9c881a855 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:19.238480 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7cb8e0c0-7dc5-44bb-bfb2-a9a9c881a855 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:19.239052 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7cb8e0c0-7dc5-44bb-bfb2-a9a9c881a855 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:19.239362 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7cb8e0c0-7dc5-44bb-bfb2-a9a9c881a855 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:19.274373 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7cb8e0c0-7dc5-44bb-bfb2-a9a9c881a855 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051555 Aug 05 07:24:19.274979 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 516/1017] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:24:19 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 07:24:19.346453 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fce652de-586a-412e-9b79-a66c7e091ee1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:19.346956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fce652de-586a-412e-9b79-a66c7e091ee1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:19.353699 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fce652de-586a-412e-9b79-a66c7e091ee1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:19.354520 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fce652de-586a-412e-9b79-a66c7e091ee1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:19.354642 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fce652de-586a-412e-9b79-a66c7e091ee1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:19.355306 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fce652de-586a-412e-9b79-a66c7e091ee1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:19.355759 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fce652de-586a-412e-9b79-a66c7e091ee1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:19.356188 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fce652de-586a-412e-9b79-a66c7e091ee1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:19.385347 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fce652de-586a-412e-9b79-a66c7e091ee1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:24:19.396046 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-15d660c3-9c43-4a94-8fc6-13594102fd5b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:19.397015 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-15d660c3-9c43-4a94-8fc6-13594102fd5b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:19.410643 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15d660c3-9c43-4a94-8fc6-13594102fd5b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:19.411206 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15d660c3-9c43-4a94-8fc6-13594102fd5b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:19.411919 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15d660c3-9c43-4a94-8fc6-13594102fd5b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:19.413067 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15d660c3-9c43-4a94-8fc6-13594102fd5b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:19.413952 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15d660c3-9c43-4a94-8fc6-13594102fd5b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:19.414551 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-15d660c3-9c43-4a94-8fc6-13594102fd5b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:19.489230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fce652de-586a-412e-9b79-a66c7e091ee1 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 204 len: 0 microversion: 2.1 time: 0.146255 Aug 05 07:24:19.491234 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 502/1018] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:24:19 2022] DELETE /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:24:19.499795 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-21f2a834-6bc7-4aa5-9563-dcf8211419f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:19.500757 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-21f2a834-6bc7-4aa5-9563-dcf8211419f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:19.507187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-21f2a834-6bc7-4aa5-9563-dcf8211419f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:19.507687 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-21f2a834-6bc7-4aa5-9563-dcf8211419f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:19.508472 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-21f2a834-6bc7-4aa5-9563-dcf8211419f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:19.509231 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-21f2a834-6bc7-4aa5-9563-dcf8211419f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:19.509681 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-21f2a834-6bc7-4aa5-9563-dcf8211419f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:19.510114 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-21f2a834-6bc7-4aa5-9563-dcf8211419f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:19.587934 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-15d660c3-9c43-4a94-8fc6-13594102fd5b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:19.597528 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-15d660c3-9c43-4a94-8fc6-13594102fd5b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.205399 Aug 05 07:24:19.598426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 517/1019] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:19 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:24:19.664374 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-21f2a834-6bc7-4aa5-9563-dcf8211419f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:19.672477 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-21f2a834-6bc7-4aa5-9563-dcf8211419f5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1683 microversion: 2.1 time: 0.176822 Aug 05 07:24:19.673235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 503/1020] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:19 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:24:19.910213 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f7aa31b8-33b6-45e1-a6bf-5b615b78382b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:19.911390 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f7aa31b8-33b6-45e1-a6bf-5b615b78382b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:19.914475 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=60 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:19.922926 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f7aa31b8-33b6-45e1-a6bf-5b615b78382b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:19.923739 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f7aa31b8-33b6-45e1-a6bf-5b615b78382b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:19.924576 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f7aa31b8-33b6-45e1-a6bf-5b615b78382b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:19.925600 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f7aa31b8-33b6-45e1-a6bf-5b615b78382b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:19.926374 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f7aa31b8-33b6-45e1-a6bf-5b615b78382b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:19.927097 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f7aa31b8-33b6-45e1-a6bf-5b615b78382b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:20.079882 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f7aa31b8-33b6-45e1-a6bf-5b615b78382b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:20.088788 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f7aa31b8-33b6-45e1-a6bf-5b615b78382b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:20.090416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f7aa31b8-33b6-45e1-a6bf-5b615b78382b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:20.091628 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f7aa31b8-33b6-45e1-a6bf-5b615b78382b tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.188298 Aug 05 07:24:20.092196 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 518/1021] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:19 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 07:24:20.619519 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-db71e757-76e4-4146-962d-b1e581e9fb4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:20.620432 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-db71e757-76e4-4146-962d-b1e581e9fb4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:20.627235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db71e757-76e4-4146-962d-b1e581e9fb4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:20.627730 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db71e757-76e4-4146-962d-b1e581e9fb4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:20.628167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db71e757-76e4-4146-962d-b1e581e9fb4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:20.628879 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db71e757-76e4-4146-962d-b1e581e9fb4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:20.629385 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db71e757-76e4-4146-962d-b1e581e9fb4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:20.629844 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db71e757-76e4-4146-962d-b1e581e9fb4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:20.694723 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a07b99ad-9ce7-4b87-8a0b-2dd77337027a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:20.695326 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a07b99ad-9ce7-4b87-8a0b-2dd77337027a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:20.702543 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a07b99ad-9ce7-4b87-8a0b-2dd77337027a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:20.703027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a07b99ad-9ce7-4b87-8a0b-2dd77337027a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:20.703733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a07b99ad-9ce7-4b87-8a0b-2dd77337027a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:20.704548 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a07b99ad-9ce7-4b87-8a0b-2dd77337027a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:20.705139 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a07b99ad-9ce7-4b87-8a0b-2dd77337027a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:20.705632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a07b99ad-9ce7-4b87-8a0b-2dd77337027a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:20.800092 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-db71e757-76e4-4146-962d-b1e581e9fb4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:20.808425 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-db71e757-76e4-4146-962d-b1e581e9fb4f tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.192791 Aug 05 07:24:20.809420 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 504/1022] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:20 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:20.882469 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a07b99ad-9ce7-4b87-8a0b-2dd77337027a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:20.892159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a07b99ad-9ce7-4b87-8a0b-2dd77337027a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1683 microversion: 2.1 time: 0.201512 Aug 05 07:24:20.892940 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 519/1023] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:20 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1683 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:24:21.119016 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d98b62a9-9da0-403c-98f8-974a7acecbb9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:21.119949 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d98b62a9-9da0-403c-98f8-974a7acecbb9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:21.126275 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d98b62a9-9da0-403c-98f8-974a7acecbb9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:21.127167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d98b62a9-9da0-403c-98f8-974a7acecbb9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:21.127761 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d98b62a9-9da0-403c-98f8-974a7acecbb9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:21.128470 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d98b62a9-9da0-403c-98f8-974a7acecbb9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:21.129331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d98b62a9-9da0-403c-98f8-974a7acecbb9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:21.129907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d98b62a9-9da0-403c-98f8-974a7acecbb9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:21.352068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d98b62a9-9da0-403c-98f8-974a7acecbb9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:21.360877 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d98b62a9-9da0-403c-98f8-974a7acecbb9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:21.362507 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d98b62a9-9da0-403c-98f8-974a7acecbb9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:21.363769 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d98b62a9-9da0-403c-98f8-974a7acecbb9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1730 microversion: 2.20 time: 0.248885 Aug 05 07:24:21.364340 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 505/1024] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:21 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:21.832603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-fce5b458-753f-4195-94ab-29655248725a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:21.833647 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-fce5b458-753f-4195-94ab-29655248725a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:21.842775 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fce5b458-753f-4195-94ab-29655248725a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:21.843274 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fce5b458-753f-4195-94ab-29655248725a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:21.843707 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fce5b458-753f-4195-94ab-29655248725a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:21.844478 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fce5b458-753f-4195-94ab-29655248725a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:21.845393 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fce5b458-753f-4195-94ab-29655248725a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:21.845393 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-fce5b458-753f-4195-94ab-29655248725a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:21.915508 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dc13f443-2d02-44cd-a77b-8f8a69471b1d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:21.916180 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dc13f443-2d02-44cd-a77b-8f8a69471b1d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:21.924608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc13f443-2d02-44cd-a77b-8f8a69471b1d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:21.925209 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc13f443-2d02-44cd-a77b-8f8a69471b1d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:21.925656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc13f443-2d02-44cd-a77b-8f8a69471b1d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:21.926437 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc13f443-2d02-44cd-a77b-8f8a69471b1d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:21.927135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc13f443-2d02-44cd-a77b-8f8a69471b1d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:21.927747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc13f443-2d02-44cd-a77b-8f8a69471b1d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:22.158523 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-fce5b458-753f-4195-94ab-29655248725a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:22.166543 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dc13f443-2d02-44cd-a77b-8f8a69471b1d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:22.174830 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-dc13f443-2d02-44cd-a77b-8f8a69471b1d tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1683 microversion: 2.1 time: 0.263717 Aug 05 07:24:22.176113 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 506/1025] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:21 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1683 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:24:22.179053 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-fce5b458-753f-4195-94ab-29655248725a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.347768 Aug 05 07:24:22.180027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 520/1026] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:21 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:24:22.388429 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0eca5411-2af3-411a-bf50-15d629c4e62e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:22.389172 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0eca5411-2af3-411a-bf50-15d629c4e62e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:22.395476 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0eca5411-2af3-411a-bf50-15d629c4e62e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:22.396525 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0eca5411-2af3-411a-bf50-15d629c4e62e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:22.396525 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0eca5411-2af3-411a-bf50-15d629c4e62e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:22.397341 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0eca5411-2af3-411a-bf50-15d629c4e62e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:22.398018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0eca5411-2af3-411a-bf50-15d629c4e62e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:22.398634 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0eca5411-2af3-411a-bf50-15d629c4e62e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:22.566174 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0eca5411-2af3-411a-bf50-15d629c4e62e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:22.574662 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0eca5411-2af3-411a-bf50-15d629c4e62e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:22.576185 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0eca5411-2af3-411a-bf50-15d629c4e62e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:22.577774 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0eca5411-2af3-411a-bf50-15d629c4e62e tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1717 microversion: 2.20 time: 0.193614 Aug 05 07:24:22.584966 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 507/1027] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:24:22 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1717 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:24:22.939199 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-e6cf64da-bbd2-4d53-95d0-8424eee0d961 req-96122866-9190-46d2-9a9f-030806ebbd60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3696e06-e4c3-4ec1-8066-c5d225e93178", "name": "network-vif-deleted", "tag": "3291dc18-378f-4672-bcf1-88fbe937b2ef"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:24:22.950430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-e6cf64da-bbd2-4d53-95d0-8424eee0d961 req-96122866-9190-46d2-9a9f-030806ebbd60 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:22.950984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-e6cf64da-bbd2-4d53-95d0-8424eee0d961 req-96122866-9190-46d2-9a9f-030806ebbd60 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:22.951480 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-e6cf64da-bbd2-4d53-95d0-8424eee0d961 req-96122866-9190-46d2-9a9f-030806ebbd60 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:22.968878 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-e6cf64da-bbd2-4d53-95d0-8424eee0d961 req-96122866-9190-46d2-9a9f-030806ebbd60 service nova] Creating event network-vif-deleted:3291dc18-378f-4672-bcf1-88fbe937b2ef for instance a3696e06-e4c3-4ec1-8066-c5d225e93178 on hv-cinder-85200 Aug 05 07:24:22.974929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-e6cf64da-bbd2-4d53-95d0-8424eee0d961 req-96122866-9190-46d2-9a9f-030806ebbd60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041377 Aug 05 07:24:22.976228 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 521/1028] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:23.206477 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-df81b71e-bf1f-463e-b3e0-9460f4695647 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:23.207515 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-df81b71e-bf1f-463e-b3e0-9460f4695647 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:23.214860 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1598fada-e135-440f-b900-c797f1f5820e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:23.215922 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1598fada-e135-440f-b900-c797f1f5820e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:23.217330 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:23.220574 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df81b71e-bf1f-463e-b3e0-9460f4695647 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:23.221514 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df81b71e-bf1f-463e-b3e0-9460f4695647 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:23.222307 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df81b71e-bf1f-463e-b3e0-9460f4695647 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:23.223582 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df81b71e-bf1f-463e-b3e0-9460f4695647 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:23.224424 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df81b71e-bf1f-463e-b3e0-9460f4695647 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:23.225261 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df81b71e-bf1f-463e-b3e0-9460f4695647 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:23.225587 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1598fada-e135-440f-b900-c797f1f5820e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:23.226337 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1598fada-e135-440f-b900-c797f1f5820e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:23.226957 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1598fada-e135-440f-b900-c797f1f5820e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:23.227940 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1598fada-e135-440f-b900-c797f1f5820e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:23.228583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1598fada-e135-440f-b900-c797f1f5820e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:23.229478 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1598fada-e135-440f-b900-c797f1f5820e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:23.317316 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1598fada-e135-440f-b900-c797f1f5820e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096d0da1a0bc401c95bfbb8fc150a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf4a49abd8479f895e68d4954412b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:23.319226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1598fada-e135-440f-b900-c797f1f5820e tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 200 len: 1615 microversion: 2.1 time: 0.108903 Aug 05 07:24:23.320535 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 522/1029] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:23 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 1615 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:24:23.460920 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-df81b71e-bf1f-463e-b3e0-9460f4695647 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:23.478028 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-df81b71e-bf1f-463e-b3e0-9460f4695647 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.277192 Aug 05 07:24:23.494180 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 508/1030] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:23 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:24.352370 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6b0e11c9-f21a-48df-ba01-ad637fd81397 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:24.353038 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-6b0e11c9-f21a-48df-ba01-ad637fd81397 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:24.360872 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6b0e11c9-f21a-48df-ba01-ad637fd81397 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:24.361383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6b0e11c9-f21a-48df-ba01-ad637fd81397 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:24.361815 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6b0e11c9-f21a-48df-ba01-ad637fd81397 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:24.362514 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6b0e11c9-f21a-48df-ba01-ad637fd81397 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:24.362968 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6b0e11c9-f21a-48df-ba01-ad637fd81397 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:24.363392 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6b0e11c9-f21a-48df-ba01-ad637fd81397 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:24.380274 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-6b0e11c9-f21a-48df-ba01-ad637fd81397 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6b0e11c9-f21a-48df-ba01-ad637fd81397 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 HTTP/1.1 Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:24:24.382059 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:24:24.384146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:24.384146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:24.384146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:24.384146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:24.384146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:24.384146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:24:24.384146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:24:24.384146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:24:24.384146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:24.384146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:24:24.384146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:24.384146 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'a3696e06-e4c3-4ec1-8066-c5d225e93178'} Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:24.385003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:24.386518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:24.387659 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6b0e11c9-f21a-48df-ba01-ad637fd81397 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 404 to user: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:24.387659 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-6b0e11c9-f21a-48df-ba01-ad637fd81397 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 404 len: 111 microversion: 2.1 time: 0.035435 Aug 05 07:24:24.387659 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 523/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:24 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:24.393349 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1e29db25-a491-4147-859b-118e02ec86d8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '.version_select at 0x7f4970576e50>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:24.398073 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1e29db25-a491-4147-859b-118e02ec86d8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [d7ee4ad4-9007-41a2-8f31-ba5e122123d9] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 07:24:24.517294 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9c07ec76-66c3-49e3-91ef-f2e346df6caa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:24.517887 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9c07ec76-66c3-49e3-91ef-f2e346df6caa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:24.524272 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9c07ec76-66c3-49e3-91ef-f2e346df6caa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:24.524753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9c07ec76-66c3-49e3-91ef-f2e346df6caa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:24.525207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9c07ec76-66c3-49e3-91ef-f2e346df6caa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:24.525913 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9c07ec76-66c3-49e3-91ef-f2e346df6caa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:24.526374 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9c07ec76-66c3-49e3-91ef-f2e346df6caa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:24.526788 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9c07ec76-66c3-49e3-91ef-f2e346df6caa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:24.696208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9c07ec76-66c3-49e3-91ef-f2e346df6caa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:24.709378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9c07ec76-66c3-49e3-91ef-f2e346df6caa tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.195764 Aug 05 07:24:24.710346 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 524/1032] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:24 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:24:25.407974 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [None req-1e29db25-a491-4147-859b-118e02ec86d8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [d7ee4ad4-9007-41a2-8f31-ba5e122123d9] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 54948. Aug 05 07:24:25.430005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1e29db25-a491-4147-859b-118e02ec86d8 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093920548" status: 202 len: 0 microversion: 2.1 time: 1.040586 Aug 05 07:24:25.430605 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 509/1033] 10.222.0.27 () {58 vars in 1221 bytes} [Fri Aug 5 07:24:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093920548 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:24:25.744447 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-43f9876f-91a7-40eb-b233-b2945200ba34 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:25.745259 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-43f9876f-91a7-40eb-b233-b2945200ba34 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:25.753656 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-43f9876f-91a7-40eb-b233-b2945200ba34 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:25.754147 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-43f9876f-91a7-40eb-b233-b2945200ba34 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:25.754580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-43f9876f-91a7-40eb-b233-b2945200ba34 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:25.755300 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-43f9876f-91a7-40eb-b233-b2945200ba34 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:25.755752 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-43f9876f-91a7-40eb-b233-b2945200ba34 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:25.756180 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-43f9876f-91a7-40eb-b233-b2945200ba34 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:26.171242 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-43f9876f-91a7-40eb-b233-b2945200ba34 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:26.186640 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-43f9876f-91a7-40eb-b233-b2945200ba34 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.446684 Aug 05 07:24:26.187237 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 525/1034] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:25 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:27.210001 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-befa382f-3c20-49c2-be66-5834fedd9ac7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:27.210616 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-befa382f-3c20-49c2-be66-5834fedd9ac7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:27.218049 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-befa382f-3c20-49c2-be66-5834fedd9ac7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:27.218556 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-befa382f-3c20-49c2-be66-5834fedd9ac7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:27.219098 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-befa382f-3c20-49c2-be66-5834fedd9ac7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:27.219814 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-befa382f-3c20-49c2-be66-5834fedd9ac7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:27.220267 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-befa382f-3c20-49c2-be66-5834fedd9ac7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:27.220693 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-befa382f-3c20-49c2-be66-5834fedd9ac7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:27.236665 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:27.384603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-befa382f-3c20-49c2-be66-5834fedd9ac7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:27.397667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-befa382f-3c20-49c2-be66-5834fedd9ac7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.193045 Aug 05 07:24:27.398303 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 510/1035] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:27 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:28.419744 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e4d064ee-b6fa-4a44-a231-ed67b45878c5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:28.420313 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e4d064ee-b6fa-4a44-a231-ed67b45878c5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:28.427621 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e4d064ee-b6fa-4a44-a231-ed67b45878c5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:28.428107 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e4d064ee-b6fa-4a44-a231-ed67b45878c5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:28.428526 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e4d064ee-b6fa-4a44-a231-ed67b45878c5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:28.429414 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e4d064ee-b6fa-4a44-a231-ed67b45878c5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:28.429870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e4d064ee-b6fa-4a44-a231-ed67b45878c5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:28.430297 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e4d064ee-b6fa-4a44-a231-ed67b45878c5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:28.584105 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e4d064ee-b6fa-4a44-a231-ed67b45878c5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:28.592355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e4d064ee-b6fa-4a44-a231-ed67b45878c5 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.176647 Aug 05 07:24:28.592923 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 526/1036] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:28 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:29.614284 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e219efa6-ea49-41ca-8ae9-0dc36f631d8c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:29.614960 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e219efa6-ea49-41ca-8ae9-0dc36f631d8c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:29.622402 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e219efa6-ea49-41ca-8ae9-0dc36f631d8c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:29.622877 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e219efa6-ea49-41ca-8ae9-0dc36f631d8c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:29.623287 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e219efa6-ea49-41ca-8ae9-0dc36f631d8c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:29.623983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e219efa6-ea49-41ca-8ae9-0dc36f631d8c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:29.624429 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e219efa6-ea49-41ca-8ae9-0dc36f631d8c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:29.624845 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e219efa6-ea49-41ca-8ae9-0dc36f631d8c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:29.787498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e219efa6-ea49-41ca-8ae9-0dc36f631d8c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:29.795811 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e219efa6-ea49-41ca-8ae9-0dc36f631d8c tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.185830 Aug 05 07:24:29.796407 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 511/1037] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:29 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:30.811058 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3f6e9a27-b72f-47a9-913b-02286639b3c7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:30.811719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3f6e9a27-b72f-47a9-913b-02286639b3c7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:30.817853 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bbd97981-f736-4731-a3fd-ea62e24a5a80 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:30.818481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bbd97981-f736-4731-a3fd-ea62e24a5a80 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:30.819534 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f6e9a27-b72f-47a9-913b-02286639b3c7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:30.820029 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f6e9a27-b72f-47a9-913b-02286639b3c7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:30.820452 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f6e9a27-b72f-47a9-913b-02286639b3c7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:30.821201 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f6e9a27-b72f-47a9-913b-02286639b3c7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:30.821650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f6e9a27-b72f-47a9-913b-02286639b3c7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:30.822074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f6e9a27-b72f-47a9-913b-02286639b3c7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:30.825180 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bbd97981-f736-4731-a3fd-ea62e24a5a80 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:30.825685 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bbd97981-f736-4731-a3fd-ea62e24a5a80 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:30.826100 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bbd97981-f736-4731-a3fd-ea62e24a5a80 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:30.826572 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=100 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:30.826873 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bbd97981-f736-4731-a3fd-ea62e24a5a80 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:30.827720 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bbd97981-f736-4731-a3fd-ea62e24a5a80 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:30.828245 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bbd97981-f736-4731-a3fd-ea62e24a5a80 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:30.838693 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-3f6e9a27-b72f-47a9-913b-02286639b3c7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3f6e9a27-b72f-47a9-913b-02286639b3c7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: DELETE /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 HTTP/1.1 Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:24:30.840278 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:24:30.842171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:30.842171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:30.842171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:30.842171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:30.842171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:30.842171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:24:30.842171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:24:30.842171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:24:30.842171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:30.842171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:24:30.842171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:30.842171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'a3696e06-e4c3-4ec1-8066-c5d225e93178'} Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:30.843057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:30.844639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:30.846053 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3f6e9a27-b72f-47a9-913b-02286639b3c7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 404 to user: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:30.846053 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3f6e9a27-b72f-47a9-913b-02286639b3c7 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 404 len: 111 microversion: 2.1 time: 0.034857 Aug 05 07:24:30.846053 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 527/1038] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:24:30 2022] DELETE /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:30.856373 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8395ec09-310f-41a3-b7e8-558ab272db45 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:30.857020 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8395ec09-310f-41a3-b7e8-558ab272db45 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: a3696e06-e4c3-4ec1-8066-c5d225e93178] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:30.863250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8395ec09-310f-41a3-b7e8-558ab272db45 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:30.863731 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8395ec09-310f-41a3-b7e8-558ab272db45 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:30.864158 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8395ec09-310f-41a3-b7e8-558ab272db45 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:30.864976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8395ec09-310f-41a3-b7e8-558ab272db45 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:30.865429 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8395ec09-310f-41a3-b7e8-558ab272db45 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:30.865845 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8395ec09-310f-41a3-b7e8-558ab272db45 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:30.881428 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-8395ec09-310f-41a3-b7e8-558ab272db45 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8395ec09-310f-41a3-b7e8-558ab272db45 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 HTTP/1.1 Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:24:30.883008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:24:30.886071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:30.886071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:30.886071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:30.886071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:30.886071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:30.886071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:24:30.886071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:24:30.886071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:24:30.886071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:30.886071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:24:30.886071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:30.886071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'a3696e06-e4c3-4ec1-8066-c5d225e93178'} Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:30.886827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. Aug 05 07:24:30.888072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:30.889196 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8395ec09-310f-41a3-b7e8-558ab272db45 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 404 to user: Instance a3696e06-e4c3-4ec1-8066-c5d225e93178 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:30.889196 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8395ec09-310f-41a3-b7e8-558ab272db45 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178" status: 404 len: 111 microversion: 2.1 time: 0.037814 Aug 05 07:24:30.889196 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 528/1039] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:30 2022] GET /compute/v2.1/servers/a3696e06-e4c3-4ec1-8066-c5d225e93178 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:30.993559 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bbd97981-f736-4731-a3fd-ea62e24a5a80 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:31.003885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bbd97981-f736-4731-a3fd-ea62e24a5a80 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.190123 Aug 05 07:24:31.004659 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 512/1040] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:30 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:24:32.028031 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5d77965c-e084-43e2-bd40-8f1c6777e178 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:32.028637 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5d77965c-e084-43e2-bd40-8f1c6777e178 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:32.036999 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5d77965c-e084-43e2-bd40-8f1c6777e178 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:32.037585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5d77965c-e084-43e2-bd40-8f1c6777e178 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:32.038027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5d77965c-e084-43e2-bd40-8f1c6777e178 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:32.038739 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5d77965c-e084-43e2-bd40-8f1c6777e178 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:32.039192 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5d77965c-e084-43e2-bd40-8f1c6777e178 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:32.039620 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5d77965c-e084-43e2-bd40-8f1c6777e178 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:32.187265 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5d77965c-e084-43e2-bd40-8f1c6777e178 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:32.195583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5d77965c-e084-43e2-bd40-8f1c6777e178 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.171432 Aug 05 07:24:32.196182 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 529/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:32 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:33.218094 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8e961b7d-1e71-4144-96f2-dfe7aaf0075d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:33.218724 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8e961b7d-1e71-4144-96f2-dfe7aaf0075d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:33.228623 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8e961b7d-1e71-4144-96f2-dfe7aaf0075d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:33.229644 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8e961b7d-1e71-4144-96f2-dfe7aaf0075d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:33.230404 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8e961b7d-1e71-4144-96f2-dfe7aaf0075d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:33.231687 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8e961b7d-1e71-4144-96f2-dfe7aaf0075d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:33.232502 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8e961b7d-1e71-4144-96f2-dfe7aaf0075d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:33.233292 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8e961b7d-1e71-4144-96f2-dfe7aaf0075d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:33.414570 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8e961b7d-1e71-4144-96f2-dfe7aaf0075d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:33.423005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8e961b7d-1e71-4144-96f2-dfe7aaf0075d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.208907 Aug 05 07:24:33.423596 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 513/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:33 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:34.443874 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ce568c11-3a62-47e8-acbd-3beeb29be05a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:34.444498 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ce568c11-3a62-47e8-acbd-3beeb29be05a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:34.451674 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ce568c11-3a62-47e8-acbd-3beeb29be05a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:34.452169 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ce568c11-3a62-47e8-acbd-3beeb29be05a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:34.452603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ce568c11-3a62-47e8-acbd-3beeb29be05a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:34.453354 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ce568c11-3a62-47e8-acbd-3beeb29be05a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:34.453815 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ce568c11-3a62-47e8-acbd-3beeb29be05a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:34.454239 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ce568c11-3a62-47e8-acbd-3beeb29be05a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:34.598041 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-ce568c11-3a62-47e8-acbd-3beeb29be05a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:34.606114 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ce568c11-3a62-47e8-acbd-3beeb29be05a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.166089 Aug 05 07:24:34.606692 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 530/1043] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:34 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:34.954031 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-b36a4421-4e56-4c8d-90fb-6b0f685fb27f req-bbd373ab-6f4c-496e-8ca5-623417f175ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45375909-399b-4df1-9ee9-5b29174c9a93", "name": "network-vif-plugged", "status": "completed", "tag": "dcba2fdc-7a5a-479c-9dad-258cf786441f"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:24:34.965397 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-b36a4421-4e56-4c8d-90fb-6b0f685fb27f req-bbd373ab-6f4c-496e-8ca5-623417f175ca service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:34.965737 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-b36a4421-4e56-4c8d-90fb-6b0f685fb27f req-bbd373ab-6f4c-496e-8ca5-623417f175ca service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:34.966169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-b36a4421-4e56-4c8d-90fb-6b0f685fb27f req-bbd373ab-6f4c-496e-8ca5-623417f175ca service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:34.993957 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-b36a4421-4e56-4c8d-90fb-6b0f685fb27f req-bbd373ab-6f4c-496e-8ca5-623417f175ca service nova] Creating event network-vif-plugged:dcba2fdc-7a5a-479c-9dad-258cf786441f for instance 45375909-399b-4df1-9ee9-5b29174c9a93 on hv-cinder-85200 Aug 05 07:24:35.004512 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-b36a4421-4e56-4c8d-90fb-6b0f685fb27f req-bbd373ab-6f4c-496e-8ca5-623417f175ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054507 Aug 05 07:24:35.005256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 514/1044] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:24:35.627290 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b81537e8-6a0d-472d-b90e-05fb8f586338 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:35.627942 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b81537e8-6a0d-472d-b90e-05fb8f586338 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:35.635462 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b81537e8-6a0d-472d-b90e-05fb8f586338 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:35.635953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b81537e8-6a0d-472d-b90e-05fb8f586338 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:35.636385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b81537e8-6a0d-472d-b90e-05fb8f586338 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:35.637133 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b81537e8-6a0d-472d-b90e-05fb8f586338 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:35.637591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b81537e8-6a0d-472d-b90e-05fb8f586338 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:35.638013 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b81537e8-6a0d-472d-b90e-05fb8f586338 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:35.826177 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b81537e8-6a0d-472d-b90e-05fb8f586338 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:35.834890 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b81537e8-6a0d-472d-b90e-05fb8f586338 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.212228 Aug 05 07:24:35.835583 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 531/1045] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:35 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:36.526967 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-de801df5-fcc8-46cb-b492-e3e53e64d257 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:36.527674 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-de801df5-fcc8-46cb-b492-e3e53e64d257 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:36.534682 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de801df5-fcc8-46cb-b492-e3e53e64d257 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:36.535178 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de801df5-fcc8-46cb-b492-e3e53e64d257 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:36.535683 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de801df5-fcc8-46cb-b492-e3e53e64d257 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:36.536632 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de801df5-fcc8-46cb-b492-e3e53e64d257 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:36.537131 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de801df5-fcc8-46cb-b492-e3e53e64d257 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:36.537567 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de801df5-fcc8-46cb-b492-e3e53e64d257 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:36.552997 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-de801df5-fcc8-46cb-b492-e3e53e64d257 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-de801df5-fcc8-46cb-b492-e3e53e64d257 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 HTTP/1.1 Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:24:36.555238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:24:36.558387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:36.558387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:36.558387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:36.558387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:36.558387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:36.558387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:24:36.558387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:24:36.558387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:24:36.558387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:36.558387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:24:36.558387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:24:36.558387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '001d9229-32a3-4aa2-9e7d-c4d306c30d49'} Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:36.559807 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:24:36.562032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.564873 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-de801df5-fcc8-46cb-b492-e3e53e64d257 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 404 to user: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:36.564873 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-de801df5-fcc8-46cb-b492-e3e53e64d257 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 404 len: 111 microversion: 2.1 time: 0.035967 Aug 05 07:24:36.564873 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 515/1046] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:24:36 2022] DELETE /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:36.569425 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ee4b0267-c598-4f57-af3d-a5a99db3684a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:36.570229 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ee4b0267-c598-4f57-af3d-a5a99db3684a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 001d9229-32a3-4aa2-9e7d-c4d306c30d49] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:36.579094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee4b0267-c598-4f57-af3d-a5a99db3684a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:36.579942 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee4b0267-c598-4f57-af3d-a5a99db3684a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:36.580277 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee4b0267-c598-4f57-af3d-a5a99db3684a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:36.581275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee4b0267-c598-4f57-af3d-a5a99db3684a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:36.581981 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee4b0267-c598-4f57-af3d-a5a99db3684a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:36.582505 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ee4b0267-c598-4f57-af3d-a5a99db3684a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:36.599071 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-ee4b0267-c598-4f57-af3d-a5a99db3684a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ee4b0267-c598-4f57-af3d-a5a99db3684a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 HTTP/1.1 Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:24:36.600644 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:24:36.603160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:36.603160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:36.603160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:36.603160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:36.603160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:36.603160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:24:36.603160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:24:36.603160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:24:36.603160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:36.603160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:24:36.603160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:24:36.603160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': '001d9229-32a3-4aa2-9e7d-c4d306c30d49'} Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:36.604821 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. Aug 05 07:24:36.607646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.610112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ee4b0267-c598-4f57-af3d-a5a99db3684a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 404 to user: Instance 001d9229-32a3-4aa2-9e7d-c4d306c30d49 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:36.610112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ee4b0267-c598-4f57-af3d-a5a99db3684a tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49" status: 404 len: 111 microversion: 2.1 time: 0.037368 Aug 05 07:24:36.610112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 532/1047] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:36 2022] GET /compute/v2.1/servers/001d9229-32a3-4aa2-9e7d-c4d306c30d49 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:36.616858 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-584a6955-3391-48a9-959f-d4d319c19f96 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:36.617445 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-584a6955-3391-48a9-959f-d4d319c19f96 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:36.625165 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-584a6955-3391-48a9-959f-d4d319c19f96 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:36.625696 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-584a6955-3391-48a9-959f-d4d319c19f96 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:36.626145 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-584a6955-3391-48a9-959f-d4d319c19f96 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:36.626876 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-584a6955-3391-48a9-959f-d4d319c19f96 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:36.627334 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-584a6955-3391-48a9-959f-d4d319c19f96 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:36.627766 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-584a6955-3391-48a9-959f-d4d319c19f96 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:36.645459 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-584a6955-3391-48a9-959f-d4d319c19f96 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-584a6955-3391-48a9-959f-d4d319c19f96 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 HTTP/1.1 Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:24:36.647135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:24:36.649140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:36.649140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:36.649140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:36.649140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:36.649140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:36.649140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:24:36.649140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:24:36.649140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:24:36.649140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:36.649140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:24:36.649140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:24:36.649140 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'ffbeb5f6-8ae7-4d07-b089-62cc142fddb1'} Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:36.650086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:24:36.651775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.653413 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-584a6955-3391-48a9-959f-d4d319c19f96 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 404 to user: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:36.653413 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-584a6955-3391-48a9-959f-d4d319c19f96 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 404 len: 111 microversion: 2.1 time: 0.039124 Aug 05 07:24:36.653413 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 516/1048] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:24:36 2022] DELETE /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:36.660193 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8d379053-3b97-41d5-8f14-ffa984cc93c5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:36.660842 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8d379053-3b97-41d5-8f14-ffa984cc93c5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: ffbeb5f6-8ae7-4d07-b089-62cc142fddb1] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:36.669767 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8d379053-3b97-41d5-8f14-ffa984cc93c5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:36.670258 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8d379053-3b97-41d5-8f14-ffa984cc93c5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:36.670697 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8d379053-3b97-41d5-8f14-ffa984cc93c5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:36.671419 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8d379053-3b97-41d5-8f14-ffa984cc93c5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:36.671876 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8d379053-3b97-41d5-8f14-ffa984cc93c5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:36.672297 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8d379053-3b97-41d5-8f14-ffa984cc93c5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:36.689409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-8d379053-3b97-41d5-8f14-ffa984cc93c5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8d379053-3b97-41d5-8f14-ffa984cc93c5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 HTTP/1.1 Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:24:36.691023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:24:36.693521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:36.693521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:36.693521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:36.693521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:36.693521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:36.693521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:24:36.693521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:24:36.693521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:24:36.693521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:36.693521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:24:36.693521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:24:36.693521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'ffbeb5f6-8ae7-4d07-b089-62cc142fddb1'} Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:36.695208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. Aug 05 07:24:36.697741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:36.700239 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8d379053-3b97-41d5-8f14-ffa984cc93c5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 404 to user: Instance ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:36.700239 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8d379053-3b97-41d5-8f14-ffa984cc93c5 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1" status: 404 len: 111 microversion: 2.1 time: 0.037568 Aug 05 07:24:36.700239 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 533/1049] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:36 2022] GET /compute/v2.1/servers/ffbeb5f6-8ae7-4d07-b089-62cc142fddb1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:36.861321 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-51098e55-bf8d-4d9f-85be-975b5133bbcc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:36.862510 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-51098e55-bf8d-4d9f-85be-975b5133bbcc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:36.876101 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-51098e55-bf8d-4d9f-85be-975b5133bbcc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:36.876998 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-51098e55-bf8d-4d9f-85be-975b5133bbcc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:36.877857 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-51098e55-bf8d-4d9f-85be-975b5133bbcc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:36.879552 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-51098e55-bf8d-4d9f-85be-975b5133bbcc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:36.880112 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-51098e55-bf8d-4d9f-85be-975b5133bbcc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:36.880846 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-51098e55-bf8d-4d9f-85be-975b5133bbcc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:37.041479 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-51098e55-bf8d-4d9f-85be-975b5133bbcc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:37.049581 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-51098e55-bf8d-4d9f-85be-975b5133bbcc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1265 microversion: 2.1 time: 0.196032 Aug 05 07:24:37.050241 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 517/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:36 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:37.862351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ba5cfd9b-a01a-4ddb-8df3-85e61a3af49c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:37.862945 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ba5cfd9b-a01a-4ddb-8df3-85e61a3af49c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:37.870491 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba5cfd9b-a01a-4ddb-8df3-85e61a3af49c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:37.871236 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba5cfd9b-a01a-4ddb-8df3-85e61a3af49c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:37.871884 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba5cfd9b-a01a-4ddb-8df3-85e61a3af49c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:37.872995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba5cfd9b-a01a-4ddb-8df3-85e61a3af49c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:37.873683 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba5cfd9b-a01a-4ddb-8df3-85e61a3af49c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:37.874296 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ba5cfd9b-a01a-4ddb-8df3-85e61a3af49c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:37.896909 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-ba5cfd9b-a01a-4ddb-8df3-85e61a3af49c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ba5cfd9b-a01a-4ddb-8df3-85e61a3af49c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: DELETE /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 HTTP/1.1 Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:24:37.899780 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:24:37.901430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:37.901430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:37.901430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:37.901430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:37.901430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:37.901430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:24:37.901430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:24:37.901430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:24:37.901430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:37.901430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:24:37.901430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:24:37.901430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': '03c3c22d-3c48-4d1b-8ee9-29c1e3268147'} Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:37.902360 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:24:37.904135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:24:37.905689 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ba5cfd9b-a01a-4ddb-8df3-85e61a3af49c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 404 to user: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:37.905689 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ba5cfd9b-a01a-4ddb-8df3-85e61a3af49c tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 404 len: 111 microversion: 2.1 time: 0.043777 Aug 05 07:24:37.905689 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 534/1051] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:24:37 2022] DELETE /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:37.915906 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b1c1bcae-a5a8-4511-92e6-b52afa67ae01 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:37.916655 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b1c1bcae-a5a8-4511-92e6-b52afa67ae01 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] [instance: 03c3c22d-3c48-4d1b-8ee9-29c1e3268147] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:37.924254 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1c1bcae-a5a8-4511-92e6-b52afa67ae01 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:37.925001 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1c1bcae-a5a8-4511-92e6-b52afa67ae01 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:37.925377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1c1bcae-a5a8-4511-92e6-b52afa67ae01 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:37.926089 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1c1bcae-a5a8-4511-92e6-b52afa67ae01 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:37.926906 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1c1bcae-a5a8-4511-92e6-b52afa67ae01 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:37.927514 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1c1bcae-a5a8-4511-92e6-b52afa67ae01 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:37.942655 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-b1c1bcae-a5a8-4511-92e6-b52afa67ae01 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] HTTP exception thrown: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b1c1bcae-a5a8-4511-92e6-b52afa67ae01 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Request method failure captured: Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 HTTP/1.1 Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MM0X4aliB82XNEQWwsbYd7VaMfGqt_vqzCtlSpsKo3BQz6zQodYj3UuY0eBZApK7Cfh9jiagXIn7Dzir-BzrYFCD8bR71x3oDrePnRxuoPlToVYODYBbkSP2-N5YLkIZZ5qPP7eHSESYAuz41BJW-NSzQMQpwUaawBtA7jPvLKOh08 Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:24:37.944286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:24:37.946179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61bf4a49abd8479f895e68d4954412b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61bf4a49abd8479f895e68d4954412b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:24:37.946179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:37.946179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 61bf4a49abd8479f895e68d4954412b2 Aug 05 07:24:37.946179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1495702764 Aug 05 07:24:37.946179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:37.946179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:24:37.946179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:24:37.946179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 096d0da1a0bc401c95bfbb8fc150a27b Aug 05 07:24:37.946179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-1495702764-project Aug 05 07:24:37.946179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:24:37.946179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:24:37.946179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '03c3c22d-3c48-4d1b-8ee9-29c1e3268147'} Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:24:37.948822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. Aug 05 07:24:37.951555 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:24:37.954057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b1c1bcae-a5a8-4511-92e6-b52afa67ae01 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] Returning 404 to user: Instance 03c3c22d-3c48-4d1b-8ee9-29c1e3268147 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:24:37.954057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b1c1bcae-a5a8-4511-92e6-b52afa67ae01 tempest-AttachVolumeNegativeTest-1495702764 tempest-AttachVolumeNegativeTest-1495702764-project] 10.222.0.27 "GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147" status: 404 len: 111 microversion: 2.1 time: 0.038025 Aug 05 07:24:37.954057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 518/1052] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:37 2022] GET /compute/v2.1/servers/03c3c22d-3c48-4d1b-8ee9-29c1e3268147 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:38.071993 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-48345004-4c2a-4064-8293-5a9ed1be9006 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:38.072569 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-48345004-4c2a-4064-8293-5a9ed1be9006 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:38.080275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48345004-4c2a-4064-8293-5a9ed1be9006 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:38.081175 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48345004-4c2a-4064-8293-5a9ed1be9006 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:38.081614 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48345004-4c2a-4064-8293-5a9ed1be9006 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:38.082874 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48345004-4c2a-4064-8293-5a9ed1be9006 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:38.082874 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48345004-4c2a-4064-8293-5a9ed1be9006 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:38.083182 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-48345004-4c2a-4064-8293-5a9ed1be9006 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:38.239162 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-48345004-4c2a-4064-8293-5a9ed1be9006 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:38.257292 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-48345004-4c2a-4064-8293-5a9ed1be9006 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1452 microversion: 2.1 time: 0.188792 Aug 05 07:24:38.273573 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 535/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:38 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:38.299235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9993f4cf-1f40-42ae-b2ab-241e5a983f63 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:24:38.299942 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9993f4cf-1f40-42ae-b2ab-241e5a983f63 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:24:38.310971 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9993f4cf-1f40-42ae-b2ab-241e5a983f63 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:38.312192 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9993f4cf-1f40-42ae-b2ab-241e5a983f63 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:38.313424 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9993f4cf-1f40-42ae-b2ab-241e5a983f63 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:38.314485 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9993f4cf-1f40-42ae-b2ab-241e5a983f63 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:38.315235 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9993f4cf-1f40-42ae-b2ab-241e5a983f63 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:38.322156 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9993f4cf-1f40-42ae-b2ab-241e5a983f63 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:38.608590 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9993f4cf-1f40-42ae-b2ab-241e5a983f63 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:24:38.616633 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9993f4cf-1f40-42ae-b2ab-241e5a983f63 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1452 microversion: 2.1 time: 0.323968 Aug 05 07:24:38.617585 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 519/1054] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:24:38 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1452 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:24:41.785955 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-782e0695-2126-4788-b794-063746fa7bdd req-0c8d3633-00aa-4fe1-9930-9bf64397bf0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45375909-399b-4df1-9ee9-5b29174c9a93", "tag": "dcba2fdc-7a5a-479c-9dad-258cf786441f"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:24:41.802633 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-782e0695-2126-4788-b794-063746fa7bdd req-0c8d3633-00aa-4fe1-9930-9bf64397bf0f service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:24:41.803664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-782e0695-2126-4788-b794-063746fa7bdd req-0c8d3633-00aa-4fe1-9930-9bf64397bf0f service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:24:41.804515 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-782e0695-2126-4788-b794-063746fa7bdd req-0c8d3633-00aa-4fe1-9930-9bf64397bf0f service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:24:41.835008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-782e0695-2126-4788-b794-063746fa7bdd req-0c8d3633-00aa-4fe1-9930-9bf64397bf0f service nova] Creating event network-changed:dcba2fdc-7a5a-479c-9dad-258cf786441f for instance 45375909-399b-4df1-9ee9-5b29174c9a93 on hv-cinder-85200 Aug 05 07:24:41.857925 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-782e0695-2126-4788-b794-063746fa7bdd req-0c8d3633-00aa-4fe1-9930-9bf64397bf0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075422 Aug 05 07:24:41.860029 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 536/1055] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:25:42.584284 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:25:42.584992 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=41 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:25:42.589562 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2b03835e-e07e-48a0-bb5e-9bd52ac713da tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:25:42.591789 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2b03835e-e07e-48a0-bb5e-9bd52ac713da tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:42.599685 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b03835e-e07e-48a0-bb5e-9bd52ac713da tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:42.600186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b03835e-e07e-48a0-bb5e-9bd52ac713da tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:42.600617 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b03835e-e07e-48a0-bb5e-9bd52ac713da tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:42.601322 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b03835e-e07e-48a0-bb5e-9bd52ac713da tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:42.601773 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b03835e-e07e-48a0-bb5e-9bd52ac713da tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:42.602197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b03835e-e07e-48a0-bb5e-9bd52ac713da tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:42.687992 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2b03835e-e07e-48a0-bb5e-9bd52ac713da tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "POST /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/action" status: 202 len: 0 microversion: 2.1 time: 0.105201 Aug 05 07:25:42.688934 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 520/1056] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:25:42 2022] POST /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 07:25:42.696659 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=37 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:25:42.697449 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=34 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:25:42.702295 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-560f64e9-2663-4a77-a2a6-09bcd2ed7928 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:42.703005 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-560f64e9-2663-4a77-a2a6-09bcd2ed7928 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:42.711094 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-560f64e9-2663-4a77-a2a6-09bcd2ed7928 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:42.711593 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-560f64e9-2663-4a77-a2a6-09bcd2ed7928 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:42.712026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-560f64e9-2663-4a77-a2a6-09bcd2ed7928 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:42.712730 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-560f64e9-2663-4a77-a2a6-09bcd2ed7928 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:42.713222 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-560f64e9-2663-4a77-a2a6-09bcd2ed7928 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:42.713672 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-560f64e9-2663-4a77-a2a6-09bcd2ed7928 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:42.874671 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-560f64e9-2663-4a77-a2a6-09bcd2ed7928 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:42.884421 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-560f64e9-2663-4a77-a2a6-09bcd2ed7928 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1749 microversion: 2.1 time: 0.190693 Aug 05 07:25:42.885036 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 537/1057] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:42 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1749 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:25:43.906739 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-126a21da-4451-44c4-b8dd-2df1080022f7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:43.907441 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-126a21da-4451-44c4-b8dd-2df1080022f7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:43.913967 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-126a21da-4451-44c4-b8dd-2df1080022f7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:43.914450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-126a21da-4451-44c4-b8dd-2df1080022f7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:43.914885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-126a21da-4451-44c4-b8dd-2df1080022f7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:43.915572 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-126a21da-4451-44c4-b8dd-2df1080022f7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:43.916025 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-126a21da-4451-44c4-b8dd-2df1080022f7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:43.916449 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-126a21da-4451-44c4-b8dd-2df1080022f7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:44.072519 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-126a21da-4451-44c4-b8dd-2df1080022f7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:44.081256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-126a21da-4451-44c4-b8dd-2df1080022f7 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1749 microversion: 2.1 time: 0.179280 Aug 05 07:25:44.081847 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 521/1058] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:43 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:45.103944 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a66dc02f-2f38-466e-bd5c-3d6803b256ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:45.104543 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a66dc02f-2f38-466e-bd5c-3d6803b256ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:45.111411 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a66dc02f-2f38-466e-bd5c-3d6803b256ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:45.111896 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a66dc02f-2f38-466e-bd5c-3d6803b256ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:45.112393 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a66dc02f-2f38-466e-bd5c-3d6803b256ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:45.113238 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a66dc02f-2f38-466e-bd5c-3d6803b256ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:45.113580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a66dc02f-2f38-466e-bd5c-3d6803b256ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:45.114008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a66dc02f-2f38-466e-bd5c-3d6803b256ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:45.294788 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a66dc02f-2f38-466e-bd5c-3d6803b256ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:45.307551 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a66dc02f-2f38-466e-bd5c-3d6803b256ac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.209217 Aug 05 07:25:45.308115 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 538/1059] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:45 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:46.330299 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-94452863-1b2b-4054-8d7c-5cd91a445512 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:46.331090 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-94452863-1b2b-4054-8d7c-5cd91a445512 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:46.337815 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-94452863-1b2b-4054-8d7c-5cd91a445512 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:46.338289 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-94452863-1b2b-4054-8d7c-5cd91a445512 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:46.338716 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-94452863-1b2b-4054-8d7c-5cd91a445512 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:46.339395 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-94452863-1b2b-4054-8d7c-5cd91a445512 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:46.339839 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-94452863-1b2b-4054-8d7c-5cd91a445512 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:46.340251 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-94452863-1b2b-4054-8d7c-5cd91a445512 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:46.508298 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-94452863-1b2b-4054-8d7c-5cd91a445512 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:46.519809 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-94452863-1b2b-4054-8d7c-5cd91a445512 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.193163 Aug 05 07:25:46.520598 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 522/1060] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:46 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:47.548023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c534037c-c8d2-4362-914b-42103084e580 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:47.548642 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c534037c-c8d2-4362-914b-42103084e580 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:47.556486 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c534037c-c8d2-4362-914b-42103084e580 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:47.556998 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c534037c-c8d2-4362-914b-42103084e580 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:47.557416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c534037c-c8d2-4362-914b-42103084e580 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:47.558100 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c534037c-c8d2-4362-914b-42103084e580 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:47.558552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c534037c-c8d2-4362-914b-42103084e580 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:47.558969 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c534037c-c8d2-4362-914b-42103084e580 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:47.719909 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c534037c-c8d2-4362-914b-42103084e580 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:47.733006 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c534037c-c8d2-4362-914b-42103084e580 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.188639 Aug 05 07:25:47.733927 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 539/1061] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:47 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:48.760786 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a9c14252-4afd-40f1-a2db-de10574aebdd tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:48.761423 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a9c14252-4afd-40f1-a2db-de10574aebdd tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:48.768358 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9c14252-4afd-40f1-a2db-de10574aebdd tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:48.768847 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9c14252-4afd-40f1-a2db-de10574aebdd tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:48.769302 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9c14252-4afd-40f1-a2db-de10574aebdd tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:48.770001 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9c14252-4afd-40f1-a2db-de10574aebdd tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:48.770482 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9c14252-4afd-40f1-a2db-de10574aebdd tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:48.770909 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9c14252-4afd-40f1-a2db-de10574aebdd tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:48.944024 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a9c14252-4afd-40f1-a2db-de10574aebdd tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:48.953240 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a9c14252-4afd-40f1-a2db-de10574aebdd tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.198315 Aug 05 07:25:48.953822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 523/1062] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:48 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:49.975231 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-230ae770-64e4-4f14-8a1a-5ce4ef8ee608 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:49.975922 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-230ae770-64e4-4f14-8a1a-5ce4ef8ee608 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:49.982656 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-230ae770-64e4-4f14-8a1a-5ce4ef8ee608 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:49.983215 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-230ae770-64e4-4f14-8a1a-5ce4ef8ee608 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:49.983738 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-230ae770-64e4-4f14-8a1a-5ce4ef8ee608 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:49.984508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-230ae770-64e4-4f14-8a1a-5ce4ef8ee608 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:49.985070 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-230ae770-64e4-4f14-8a1a-5ce4ef8ee608 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:49.985561 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-230ae770-64e4-4f14-8a1a-5ce4ef8ee608 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:50.135648 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-230ae770-64e4-4f14-8a1a-5ce4ef8ee608 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:50.143959 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-230ae770-64e4-4f14-8a1a-5ce4ef8ee608 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.172933 Aug 05 07:25:50.144502 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 540/1063] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:49 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:51.165129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f7f3f8cb-4cc4-4aea-8955-510dd6b9e01d tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:51.166321 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f7f3f8cb-4cc4-4aea-8955-510dd6b9e01d tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:51.173651 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f7f3f8cb-4cc4-4aea-8955-510dd6b9e01d tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:51.174127 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f7f3f8cb-4cc4-4aea-8955-510dd6b9e01d tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:51.174563 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f7f3f8cb-4cc4-4aea-8955-510dd6b9e01d tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:51.175365 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f7f3f8cb-4cc4-4aea-8955-510dd6b9e01d tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:51.175824 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f7f3f8cb-4cc4-4aea-8955-510dd6b9e01d tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:51.176248 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f7f3f8cb-4cc4-4aea-8955-510dd6b9e01d tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:51.330505 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f7f3f8cb-4cc4-4aea-8955-510dd6b9e01d tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:51.338931 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f7f3f8cb-4cc4-4aea-8955-510dd6b9e01d tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.177830 Aug 05 07:25:51.339585 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 524/1064] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:51 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:52.361054 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b83fa1eb-f6a3-4087-9040-ed46185fc336 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:52.361629 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b83fa1eb-f6a3-4087-9040-ed46185fc336 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:52.369111 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b83fa1eb-f6a3-4087-9040-ed46185fc336 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:52.369620 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b83fa1eb-f6a3-4087-9040-ed46185fc336 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:52.370074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b83fa1eb-f6a3-4087-9040-ed46185fc336 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:52.370875 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b83fa1eb-f6a3-4087-9040-ed46185fc336 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:52.371390 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b83fa1eb-f6a3-4087-9040-ed46185fc336 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:52.371854 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b83fa1eb-f6a3-4087-9040-ed46185fc336 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:52.532290 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b83fa1eb-f6a3-4087-9040-ed46185fc336 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:52.540859 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b83fa1eb-f6a3-4087-9040-ed46185fc336 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.184130 Aug 05 07:25:52.541432 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 541/1065] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:52 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:53.563323 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-06028bfa-eca5-413d-af27-b7f356d1d954 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:53.563930 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-06028bfa-eca5-413d-af27-b7f356d1d954 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:53.571003 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06028bfa-eca5-413d-af27-b7f356d1d954 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:53.571490 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06028bfa-eca5-413d-af27-b7f356d1d954 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:53.571922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06028bfa-eca5-413d-af27-b7f356d1d954 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:53.572614 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06028bfa-eca5-413d-af27-b7f356d1d954 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:53.573132 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06028bfa-eca5-413d-af27-b7f356d1d954 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:53.573553 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06028bfa-eca5-413d-af27-b7f356d1d954 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:53.740362 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-06028bfa-eca5-413d-af27-b7f356d1d954 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:53.748726 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-06028bfa-eca5-413d-af27-b7f356d1d954 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.190455 Aug 05 07:25:53.749326 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 525/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:53 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:54.770846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0b7d3f74-3be4-457c-b424-edf38d245300 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:54.771587 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0b7d3f74-3be4-457c-b424-edf38d245300 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:54.779272 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0b7d3f74-3be4-457c-b424-edf38d245300 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:54.779760 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0b7d3f74-3be4-457c-b424-edf38d245300 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:54.780192 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0b7d3f74-3be4-457c-b424-edf38d245300 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:54.780889 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0b7d3f74-3be4-457c-b424-edf38d245300 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:54.781397 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0b7d3f74-3be4-457c-b424-edf38d245300 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:54.781820 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0b7d3f74-3be4-457c-b424-edf38d245300 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:54.945090 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0b7d3f74-3be4-457c-b424-edf38d245300 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:54.953899 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0b7d3f74-3be4-457c-b424-edf38d245300 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.187074 Aug 05 07:25:54.954561 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 542/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:54 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:55.978307 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b921b381-2305-4576-a045-aec3caab7eac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:55.978938 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b921b381-2305-4576-a045-aec3caab7eac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:55.986741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b921b381-2305-4576-a045-aec3caab7eac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:55.986741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b921b381-2305-4576-a045-aec3caab7eac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:55.986741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b921b381-2305-4576-a045-aec3caab7eac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:55.988348 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b921b381-2305-4576-a045-aec3caab7eac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:55.988798 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b921b381-2305-4576-a045-aec3caab7eac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:55.989253 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b921b381-2305-4576-a045-aec3caab7eac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:56.149146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b921b381-2305-4576-a045-aec3caab7eac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:56.158666 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b921b381-2305-4576-a045-aec3caab7eac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.184405 Aug 05 07:25:56.158666 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 526/1068] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:55 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:57.182431 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e66e725a-a356-4404-9346-5354597f739b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:57.183056 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e66e725a-a356-4404-9346-5354597f739b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:57.190122 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e66e725a-a356-4404-9346-5354597f739b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:57.190626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e66e725a-a356-4404-9346-5354597f739b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:57.191036 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e66e725a-a356-4404-9346-5354597f739b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:57.191729 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e66e725a-a356-4404-9346-5354597f739b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:57.192181 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e66e725a-a356-4404-9346-5354597f739b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:57.192601 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e66e725a-a356-4404-9346-5354597f739b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:57.346145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e66e725a-a356-4404-9346-5354597f739b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:57.355656 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e66e725a-a356-4404-9346-5354597f739b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.179471 Aug 05 07:25:57.356279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 543/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:57 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:58.388271 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-de066b11-66d6-4e2d-8323-46d850c65f7c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:58.388889 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-de066b11-66d6-4e2d-8323-46d850c65f7c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:58.395474 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de066b11-66d6-4e2d-8323-46d850c65f7c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:58.395950 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de066b11-66d6-4e2d-8323-46d850c65f7c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:58.396383 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de066b11-66d6-4e2d-8323-46d850c65f7c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:58.397125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de066b11-66d6-4e2d-8323-46d850c65f7c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:58.397577 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de066b11-66d6-4e2d-8323-46d850c65f7c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:58.397998 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de066b11-66d6-4e2d-8323-46d850c65f7c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:58.552821 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-de066b11-66d6-4e2d-8323-46d850c65f7c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:58.561512 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-de066b11-66d6-4e2d-8323-46d850c65f7c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.177374 Aug 05 07:25:58.562116 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 527/1070] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:58 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:25:59.584767 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9988d3fc-bb58-4567-9730-b944283a1cac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:25:59.585872 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9988d3fc-bb58-4567-9730-b944283a1cac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:25:59.596389 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9988d3fc-bb58-4567-9730-b944283a1cac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:59.597042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9988d3fc-bb58-4567-9730-b944283a1cac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:59.597731 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9988d3fc-bb58-4567-9730-b944283a1cac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:59.598867 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9988d3fc-bb58-4567-9730-b944283a1cac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:25:59.599828 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9988d3fc-bb58-4567-9730-b944283a1cac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:25:59.600511 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9988d3fc-bb58-4567-9730-b944283a1cac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:25:59.764769 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9988d3fc-bb58-4567-9730-b944283a1cac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:25:59.774088 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9988d3fc-bb58-4567-9730-b944283a1cac tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.195261 Aug 05 07:25:59.774684 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 544/1071] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:25:59 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:00.795755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f98c0da0-c050-4c72-be95-6e60fc10a371 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:00.796435 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f98c0da0-c050-4c72-be95-6e60fc10a371 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:00.803979 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f98c0da0-c050-4c72-be95-6e60fc10a371 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:00.804505 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f98c0da0-c050-4c72-be95-6e60fc10a371 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:00.804967 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f98c0da0-c050-4c72-be95-6e60fc10a371 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:00.805670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f98c0da0-c050-4c72-be95-6e60fc10a371 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:00.806144 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f98c0da0-c050-4c72-be95-6e60fc10a371 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:00.806554 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f98c0da0-c050-4c72-be95-6e60fc10a371 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:00.972322 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f98c0da0-c050-4c72-be95-6e60fc10a371 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:00.982971 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f98c0da0-c050-4c72-be95-6e60fc10a371 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.191383 Aug 05 07:26:00.983665 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 528/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:00 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:02.005206 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e221d659-f962-4824-8609-5d8d7524ce98 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:02.005801 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e221d659-f962-4824-8609-5d8d7524ce98 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:02.013145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e221d659-f962-4824-8609-5d8d7524ce98 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:02.013621 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e221d659-f962-4824-8609-5d8d7524ce98 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:02.014050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e221d659-f962-4824-8609-5d8d7524ce98 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:02.014742 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e221d659-f962-4824-8609-5d8d7524ce98 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:02.015295 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e221d659-f962-4824-8609-5d8d7524ce98 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:02.015587 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e221d659-f962-4824-8609-5d8d7524ce98 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:02.068092 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cb6b457f-e85e-4007-8382-3bb8d72492d0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:02.070175 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cb6b457f-e85e-4007-8382-3bb8d72492d0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:02.077772 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cb6b457f-e85e-4007-8382-3bb8d72492d0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:02.078223 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cb6b457f-e85e-4007-8382-3bb8d72492d0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:02.078653 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cb6b457f-e85e-4007-8382-3bb8d72492d0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:02.079354 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cb6b457f-e85e-4007-8382-3bb8d72492d0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:02.079797 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cb6b457f-e85e-4007-8382-3bb8d72492d0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:02.080208 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cb6b457f-e85e-4007-8382-3bb8d72492d0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:02.114029 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cb6b457f-e85e-4007-8382-3bb8d72492d0 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050112 Aug 05 07:26:02.114642 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 529/1073] 10.222.0.27 () {60 vars in 1343 bytes} [Fri Aug 5 07:26:02 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:02.187882 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-849d0e6d-7efd-48ed-a5c7-9745876858c9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:02.188504 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-849d0e6d-7efd-48ed-a5c7-9745876858c9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:02.195056 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-849d0e6d-7efd-48ed-a5c7-9745876858c9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:02.195861 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-849d0e6d-7efd-48ed-a5c7-9745876858c9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:02.196363 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-849d0e6d-7efd-48ed-a5c7-9745876858c9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:02.197329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-849d0e6d-7efd-48ed-a5c7-9745876858c9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:02.197848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-849d0e6d-7efd-48ed-a5c7-9745876858c9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:02.198454 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-849d0e6d-7efd-48ed-a5c7-9745876858c9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:02.229680 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-849d0e6d-7efd-48ed-a5c7-9745876858c9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:26:02.322777 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-849d0e6d-7efd-48ed-a5c7-9745876858c9 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 204 len: 0 microversion: 2.20 time: 0.138679 Aug 05 07:26:02.327639 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 530/1074] 10.222.0.27 () {60 vars in 1280 bytes} [Fri Aug 5 07:26:02 2022] DELETE /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 05 07:26:02.333649 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-227f42fd-5037-416e-b777-13d10e3c1c7a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:02.334399 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-227f42fd-5037-416e-b777-13d10e3c1c7a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:02.341291 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-227f42fd-5037-416e-b777-13d10e3c1c7a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:02.341825 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-227f42fd-5037-416e-b777-13d10e3c1c7a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:02.342259 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-227f42fd-5037-416e-b777-13d10e3c1c7a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:02.342965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-227f42fd-5037-416e-b777-13d10e3c1c7a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:02.343418 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-227f42fd-5037-416e-b777-13d10e3c1c7a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:02.343848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-227f42fd-5037-416e-b777-13d10e3c1c7a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:02.426834 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e221d659-f962-4824-8609-5d8d7524ce98 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:02.436534 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e221d659-f962-4824-8609-5d8d7524ce98 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.435114 Aug 05 07:26:02.437124 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 545/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:02 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:02.492537 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-227f42fd-5037-416e-b777-13d10e3c1c7a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:02.501172 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-227f42fd-5037-416e-b777-13d10e3c1c7a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:02.502647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-227f42fd-5037-416e-b777-13d10e3c1c7a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:02.503802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-227f42fd-5037-416e-b777-13d10e3c1c7a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.174834 Aug 05 07:26:02.504368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 531/1076] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:26:02 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:26:03.457557 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1e99bb05-e2d9-43c6-aa9a-0e2fb4f12432 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:03.459334 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1e99bb05-e2d9-43c6-aa9a-0e2fb4f12432 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:03.466170 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1e99bb05-e2d9-43c6-aa9a-0e2fb4f12432 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:03.466924 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1e99bb05-e2d9-43c6-aa9a-0e2fb4f12432 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:03.467413 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1e99bb05-e2d9-43c6-aa9a-0e2fb4f12432 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:03.468443 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1e99bb05-e2d9-43c6-aa9a-0e2fb4f12432 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:03.469103 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1e99bb05-e2d9-43c6-aa9a-0e2fb4f12432 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:03.469848 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1e99bb05-e2d9-43c6-aa9a-0e2fb4f12432 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:03.540097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d7c7435c-6a46-4401-8788-aa275f497835 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:03.540932 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d7c7435c-6a46-4401-8788-aa275f497835 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:03.549952 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d7c7435c-6a46-4401-8788-aa275f497835 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:03.550460 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d7c7435c-6a46-4401-8788-aa275f497835 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:03.551063 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d7c7435c-6a46-4401-8788-aa275f497835 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:03.551961 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d7c7435c-6a46-4401-8788-aa275f497835 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:03.552449 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d7c7435c-6a46-4401-8788-aa275f497835 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:03.552976 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d7c7435c-6a46-4401-8788-aa275f497835 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:03.663435 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1e99bb05-e2d9-43c6-aa9a-0e2fb4f12432 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:03.672087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1e99bb05-e2d9-43c6-aa9a-0e2fb4f12432 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.218812 Aug 05 07:26:03.672649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 546/1077] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:03 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:04.123181 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d7c7435c-6a46-4401-8788-aa275f497835 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:04.138702 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d7c7435c-6a46-4401-8788-aa275f497835 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:04.142084 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d7c7435c-6a46-4401-8788-aa275f497835 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:04.144603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d7c7435c-6a46-4401-8788-aa275f497835 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.609108 Aug 05 07:26:04.145697 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 532/1078] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:26:03 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:26:04.698008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e63ef2bc-8eed-47e4-8589-04899c574234 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:04.699209 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e63ef2bc-8eed-47e4-8589-04899c574234 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:04.712736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e63ef2bc-8eed-47e4-8589-04899c574234 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:04.713764 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e63ef2bc-8eed-47e4-8589-04899c574234 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:04.714483 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e63ef2bc-8eed-47e4-8589-04899c574234 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:04.715622 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e63ef2bc-8eed-47e4-8589-04899c574234 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:04.716419 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e63ef2bc-8eed-47e4-8589-04899c574234 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:04.717358 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e63ef2bc-8eed-47e4-8589-04899c574234 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:05.025858 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e63ef2bc-8eed-47e4-8589-04899c574234 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:05.040110 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e63ef2bc-8eed-47e4-8589-04899c574234 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.350340 Aug 05 07:26:05.054576 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 547/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:04 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:05.169642 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f95389c0-afe9-4fbb-bf44-943f33fead6f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:05.170560 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f95389c0-afe9-4fbb-bf44-943f33fead6f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:05.177472 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f95389c0-afe9-4fbb-bf44-943f33fead6f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:05.178363 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f95389c0-afe9-4fbb-bf44-943f33fead6f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:05.182656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f95389c0-afe9-4fbb-bf44-943f33fead6f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:05.182656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f95389c0-afe9-4fbb-bf44-943f33fead6f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:05.182656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f95389c0-afe9-4fbb-bf44-943f33fead6f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:05.182656 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f95389c0-afe9-4fbb-bf44-943f33fead6f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:05.502763 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f95389c0-afe9-4fbb-bf44-943f33fead6f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:05.506638 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:05.514538 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f95389c0-afe9-4fbb-bf44-943f33fead6f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:05.516061 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f95389c0-afe9-4fbb-bf44-943f33fead6f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:05.517582 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f95389c0-afe9-4fbb-bf44-943f33fead6f tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1723 microversion: 2.20 time: 0.352574 Aug 05 07:26:05.518151 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 533/1080] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:26:05 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:26:06.085892 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0d402f14-7123-4b29-883b-244be0cb511e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:06.087250 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0d402f14-7123-4b29-883b-244be0cb511e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:06.100046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d402f14-7123-4b29-883b-244be0cb511e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:06.102114 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d402f14-7123-4b29-883b-244be0cb511e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:06.104716 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d402f14-7123-4b29-883b-244be0cb511e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:06.106322 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d402f14-7123-4b29-883b-244be0cb511e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:06.107300 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d402f14-7123-4b29-883b-244be0cb511e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:06.108392 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d402f14-7123-4b29-883b-244be0cb511e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:06.355249 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-2da08e46-6cf6-46a7-b7c6-b1243b8e6cd8 req-1817787c-a94a-40d5-bdec-bd0acd2169fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d197c94-dfa3-4fe2-974d-4134fb0cb595", "name": "network-vif-deleted", "tag": "155ed77d-f493-45be-ad25-67f9052f1659"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:26:06.367393 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-2da08e46-6cf6-46a7-b7c6-b1243b8e6cd8 req-1817787c-a94a-40d5-bdec-bd0acd2169fa service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:06.368265 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-2da08e46-6cf6-46a7-b7c6-b1243b8e6cd8 req-1817787c-a94a-40d5-bdec-bd0acd2169fa service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:06.368769 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-2da08e46-6cf6-46a7-b7c6-b1243b8e6cd8 req-1817787c-a94a-40d5-bdec-bd0acd2169fa service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:06.397457 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-2da08e46-6cf6-46a7-b7c6-b1243b8e6cd8 req-1817787c-a94a-40d5-bdec-bd0acd2169fa service nova] Creating event network-vif-deleted:155ed77d-f493-45be-ad25-67f9052f1659 for instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 on hv-cinder-85200 Aug 05 07:26:06.413686 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-2da08e46-6cf6-46a7-b7c6-b1243b8e6cd8 req-1817787c-a94a-40d5-bdec-bd0acd2169fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.351955 Aug 05 07:26:06.415685 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 548/1081] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:26:06.418282 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0d402f14-7123-4b29-883b-244be0cb511e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:06.427907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0d402f14-7123-4b29-883b-244be0cb511e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1754 microversion: 2.1 time: 0.351691 Aug 05 07:26:06.428501 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 534/1082] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:06 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1754 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:26:06.553585 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:06.554232 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:06.565436 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:06.565863 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:06.566332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:06.566846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:06.567329 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:06.567721 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:06.606991 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:06.607499 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:06.608149 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:06.608574 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lazy-loading 'fault' on Instance uuid 5d197c94-dfa3-4fe2-974d-4134fb0cb595 {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:26:06.685509 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:06.698839 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:06.702714 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '723cdd3baceb4f51a57df4863af99c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:06.705892 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-802d25d9-236e-4e3f-a9d3-fe4cdce0499a tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 200 len: 1371 microversion: 2.20 time: 0.156163 Aug 05 07:26:06.707665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 549/1083] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:26:06 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 07:26:07.451637 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2a52497f-8f6a-48b0-b383-a0bb05284281 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:07.453803 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2a52497f-8f6a-48b0-b383-a0bb05284281 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:07.465381 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a52497f-8f6a-48b0-b383-a0bb05284281 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:07.466332 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a52497f-8f6a-48b0-b383-a0bb05284281 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:07.466767 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a52497f-8f6a-48b0-b383-a0bb05284281 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:07.467755 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a52497f-8f6a-48b0-b383-a0bb05284281 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:07.468249 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a52497f-8f6a-48b0-b383-a0bb05284281 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:07.469368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a52497f-8f6a-48b0-b383-a0bb05284281 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:07.677259 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2a52497f-8f6a-48b0-b383-a0bb05284281 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:07.691620 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2a52497f-8f6a-48b0-b383-a0bb05284281 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1757 microversion: 2.1 time: 0.245536 Aug 05 07:26:07.694677 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 535/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:07 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1757 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:07.745174 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a55ce409-a389-4a00-95c0-31ce9ffd7820 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:07.746322 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a55ce409-a389-4a00-95c0-31ce9ffd7820 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:07.759096 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a55ce409-a389-4a00-95c0-31ce9ffd7820 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:07.759892 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a55ce409-a389-4a00-95c0-31ce9ffd7820 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:07.760664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a55ce409-a389-4a00-95c0-31ce9ffd7820 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:07.761951 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a55ce409-a389-4a00-95c0-31ce9ffd7820 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:07.762752 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a55ce409-a389-4a00-95c0-31ce9ffd7820 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:07.763463 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a55ce409-a389-4a00-95c0-31ce9ffd7820 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:07.784383 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-a55ce409-a389-4a00-95c0-31ce9ffd7820 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] HTTP exception thrown: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a55ce409-a389-4a00-95c0-31ce9ffd7820 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Request method failure captured: Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 HTTP/1.1 Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MOkhlZtna41j2Y-lGyoDQsuQs1nBOgOAGA7HNPtonJ6KaI55B26wAQrSxM8bxgj35LDuzk_w6WMhL9fd4rTzLZvoHPrU5GIl8o8xHqP0q7vav6maAEbq5GwF1olu80B06DeDXAMU1IOZxFnKHcluEfRpXv6h2NrAYPZLwQbCv5pPQw Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: f3385eb4afc441ba834ec0ddc1c3fd9a Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:26:07.787416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:26:07.789378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f3385eb4afc441ba834ec0ddc1c3fd9a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:26:07.789378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:07.789378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: f3385eb4afc441ba834ec0ddc1c3fd9a Aug 05 07:26:07.789378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:07.789378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeShelveTestJSON-505625477-project Aug 05 07:26:07.789378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:26:07.789378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:26:07.789378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 723cdd3baceb4f51a57df4863af99c3e Aug 05 07:26:07.789378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeShelveTestJSON-505625477-project Aug 05 07:26:07.789378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:26:07.789378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:07.789378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': '5d197c94-dfa3-4fe2-974d-4134fb0cb595'} Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:26:07.790388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:07.791984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:07.794042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a55ce409-a389-4a00-95c0-31ce9ffd7820 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Returning 404 to user: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:26:07.794042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a55ce409-a389-4a00-95c0-31ce9ffd7820 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 404 len: 111 microversion: 2.20 time: 0.051670 Aug 05 07:26:07.794042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 550/1085] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:26:07 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 07:26:07.804134 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-be8165a8-74af-457e-b5c1-5defe8e20e5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '.version_select at 0x7f4970562790>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:07.826329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-be8165a8-74af-457e-b5c1-5defe8e20e5c tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721325610" status: 204 len: 0 microversion: 2.20 time: 0.027106 Aug 05 07:26:07.826931 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 536/1086] 10.222.0.27 () {60 vars in 1262 bytes} [Fri Aug 5 07:26:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721325610 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 07:26:08.271302 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-798682168", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "networks": [{"uuid": "948ebe5d-b030-4d83-b873-ebe4af1c28e3"}]}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:26:08.356751 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] validate_networks() for [('948ebe5d-b030-4d83-b873-ebe4af1c28e3', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:26:08.868650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:26:08.869368 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:26:08.869586 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:26:08.869989 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:26:08.870395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:26:08.879976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:08.880459 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:08.880887 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:08.881653 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:08.882113 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:08.882883 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:08.903388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Getting quotas for project f5b80306557f466c911aba552768c24e. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:26:08.907976 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Getting quotas for user a8662b6620724850b0bae866c518a100 and project f5b80306557f466c911aba552768c24e. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:26:08.919768 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:26:08.922365 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:26:08.971083 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b20d2e86-8db4-4364-88a8-4eb990636b09 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706861 Aug 05 07:26:08.972588 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 551/1087] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:26:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:26:08.991612 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-735371c2-a7b4-4571-8eaa-51494c2319d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:08.992750 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-735371c2-a7b4-4571-8eaa-51494c2319d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:09.075202 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-735371c2-a7b4-4571-8eaa-51494c2319d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:09.084921 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-735371c2-a7b4-4571-8eaa-51494c2319d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1218 microversion: 2.1 time: 0.101091 Aug 05 07:26:09.085932 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 537/1088] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:08 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:09.839374 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e7fe4eac-1576-4230-b784-054096740965 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:09.840106 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e7fe4eac-1576-4230-b784-054096740965 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:09.851006 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7fe4eac-1576-4230-b784-054096740965 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:09.851779 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7fe4eac-1576-4230-b784-054096740965 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:09.852516 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7fe4eac-1576-4230-b784-054096740965 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:09.853812 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7fe4eac-1576-4230-b784-054096740965 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:09.854604 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7fe4eac-1576-4230-b784-054096740965 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:09.855285 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e7fe4eac-1576-4230-b784-054096740965 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:09.874372 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-e7fe4eac-1576-4230-b784-054096740965 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] HTTP exception thrown: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e7fe4eac-1576-4230-b784-054096740965 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Request method failure captured: Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: DELETE /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 HTTP/1.1 Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MOkhlZtna41j2Y-lGyoDQsuQs1nBOgOAGA7HNPtonJ6KaI55B26wAQrSxM8bxgj35LDuzk_w6WMhL9fd4rTzLZvoHPrU5GIl8o8xHqP0q7vav6maAEbq5GwF1olu80B06DeDXAMU1IOZxFnKHcluEfRpXv6h2NrAYPZLwQbCv5pPQw Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: f3385eb4afc441ba834ec0ddc1c3fd9a Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:26:09.875995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:26:09.877789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f3385eb4afc441ba834ec0ddc1c3fd9a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:26:09.877789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:09.877789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: f3385eb4afc441ba834ec0ddc1c3fd9a Aug 05 07:26:09.877789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:09.877789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeShelveTestJSON-505625477-project Aug 05 07:26:09.877789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:26:09.877789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:26:09.877789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 723cdd3baceb4f51a57df4863af99c3e Aug 05 07:26:09.877789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeShelveTestJSON-505625477-project Aug 05 07:26:09.877789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:26:09.877789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:09.877789 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': '5d197c94-dfa3-4fe2-974d-4134fb0cb595'} Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:26:09.878912 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:09.880476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:09.882043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e7fe4eac-1576-4230-b784-054096740965 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Returning 404 to user: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:26:09.882043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e7fe4eac-1576-4230-b784-054096740965 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 404 len: 111 microversion: 2.20 time: 0.043384 Aug 05 07:26:09.882043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 552/1089] 10.222.0.27 () {60 vars in 1280 bytes} [Fri Aug 5 07:26:09 2022] DELETE /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 07:26:09.887046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a1ebaf7a-a4b9-4c35-8d41-4305e87a5405 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:09.887659 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a1ebaf7a-a4b9-4c35-8d41-4305e87a5405 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: 5d197c94-dfa3-4fe2-974d-4134fb0cb595] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:09.894545 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a1ebaf7a-a4b9-4c35-8d41-4305e87a5405 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:09.895041 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a1ebaf7a-a4b9-4c35-8d41-4305e87a5405 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:09.895474 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a1ebaf7a-a4b9-4c35-8d41-4305e87a5405 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:09.896191 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a1ebaf7a-a4b9-4c35-8d41-4305e87a5405 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:09.896650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a1ebaf7a-a4b9-4c35-8d41-4305e87a5405 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:09.897170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a1ebaf7a-a4b9-4c35-8d41-4305e87a5405 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:09.913932 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-a1ebaf7a-a4b9-4c35-8d41-4305e87a5405 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] HTTP exception thrown: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a1ebaf7a-a4b9-4c35-8d41-4305e87a5405 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Request method failure captured: Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 HTTP/1.1 Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MOkhlZtna41j2Y-lGyoDQsuQs1nBOgOAGA7HNPtonJ6KaI55B26wAQrSxM8bxgj35LDuzk_w6WMhL9fd4rTzLZvoHPrU5GIl8o8xHqP0q7vav6maAEbq5GwF1olu80B06DeDXAMU1IOZxFnKHcluEfRpXv6h2NrAYPZLwQbCv5pPQw Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: f3385eb4afc441ba834ec0ddc1c3fd9a Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:26:09.915667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:26:09.917850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f3385eb4afc441ba834ec0ddc1c3fd9a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:26:09.917850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:09.917850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: f3385eb4afc441ba834ec0ddc1c3fd9a Aug 05 07:26:09.917850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:09.917850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeShelveTestJSON-505625477-project Aug 05 07:26:09.917850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:26:09.917850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:26:09.917850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 723cdd3baceb4f51a57df4863af99c3e Aug 05 07:26:09.917850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeShelveTestJSON-505625477-project Aug 05 07:26:09.917850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:26:09.917850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:09.917850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '5d197c94-dfa3-4fe2-974d-4134fb0cb595'} Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:26:09.919239 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. Aug 05 07:26:09.921006 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:26:09.922537 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a1ebaf7a-a4b9-4c35-8d41-4305e87a5405 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Returning 404 to user: Instance 5d197c94-dfa3-4fe2-974d-4134fb0cb595 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:26:09.922537 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a1ebaf7a-a4b9-4c35-8d41-4305e87a5405 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595" status: 404 len: 111 microversion: 2.20 time: 0.034378 Aug 05 07:26:09.922537 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 538/1090] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:26:09 2022] GET /compute/v2.1/servers/5d197c94-dfa3-4fe2-974d-4134fb0cb595 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 07:26:10.105751 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-46c4f475-7ea2-498c-90e3-10478feefeb2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:10.106364 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-46c4f475-7ea2-498c-90e3-10478feefeb2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:10.113151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46c4f475-7ea2-498c-90e3-10478feefeb2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:10.113635 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46c4f475-7ea2-498c-90e3-10478feefeb2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:10.114057 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46c4f475-7ea2-498c-90e3-10478feefeb2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:10.114741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46c4f475-7ea2-498c-90e3-10478feefeb2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:10.115206 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46c4f475-7ea2-498c-90e3-10478feefeb2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:10.115611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-46c4f475-7ea2-498c-90e3-10478feefeb2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:10.199179 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-46c4f475-7ea2-498c-90e3-10478feefeb2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:10.211586 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-46c4f475-7ea2-498c-90e3-10478feefeb2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1270 microversion: 2.1 time: 0.109651 Aug 05 07:26:10.212289 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 553/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:10 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:11.087397 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ab0c5c7d-c35c-4dc4-a28b-6f66cd798351 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:11.088115 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ab0c5c7d-c35c-4dc4-a28b-6f66cd798351 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:11.096834 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab0c5c7d-c35c-4dc4-a28b-6f66cd798351 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:11.097903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab0c5c7d-c35c-4dc4-a28b-6f66cd798351 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:11.098500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab0c5c7d-c35c-4dc4-a28b-6f66cd798351 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:11.099759 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab0c5c7d-c35c-4dc4-a28b-6f66cd798351 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:11.100370 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab0c5c7d-c35c-4dc4-a28b-6f66cd798351 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:11.100952 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab0c5c7d-c35c-4dc4-a28b-6f66cd798351 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:11.116844 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-ab0c5c7d-c35c-4dc4-a28b-6f66cd798351 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] HTTP exception thrown: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ab0c5c7d-c35c-4dc4-a28b-6f66cd798351 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Request method failure captured: Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 HTTP/1.1 Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MOkhlZtna41j2Y-lGyoDQsuQs1nBOgOAGA7HNPtonJ6KaI55B26wAQrSxM8bxgj35LDuzk_w6WMhL9fd4rTzLZvoHPrU5GIl8o8xHqP0q7vav6maAEbq5GwF1olu80B06DeDXAMU1IOZxFnKHcluEfRpXv6h2NrAYPZLwQbCv5pPQw Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: f3385eb4afc441ba834ec0ddc1c3fd9a Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:26:11.118481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:26:11.120190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f3385eb4afc441ba834ec0ddc1c3fd9a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:26:11.120190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:11.120190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: f3385eb4afc441ba834ec0ddc1c3fd9a Aug 05 07:26:11.120190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:11.120190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeShelveTestJSON-505625477-project Aug 05 07:26:11.120190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:26:11.120190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:26:11.120190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 723cdd3baceb4f51a57df4863af99c3e Aug 05 07:26:11.120190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeShelveTestJSON-505625477-project Aug 05 07:26:11.120190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:26:11.120190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:26:11.120190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'f664511a-28db-4ff6-90e9-7e2db58e94e2'} Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:26:11.121198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:26:11.122705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:26:11.124248 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ab0c5c7d-c35c-4dc4-a28b-6f66cd798351 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Returning 404 to user: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:26:11.124248 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ab0c5c7d-c35c-4dc4-a28b-6f66cd798351 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 404 len: 111 microversion: 2.20 time: 0.036536 Aug 05 07:26:11.124248 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 539/1092] 10.222.0.27 () {60 vars in 1280 bytes} [Fri Aug 5 07:26:11 2022] DELETE /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 07:26:11.135036 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b3907ab5-3b48-46d0-97cc-aa9fe4aff5f4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:11.135650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b3907ab5-3b48-46d0-97cc-aa9fe4aff5f4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] [instance: f664511a-28db-4ff6-90e9-7e2db58e94e2] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:11.142273 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b3907ab5-3b48-46d0-97cc-aa9fe4aff5f4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:11.143030 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b3907ab5-3b48-46d0-97cc-aa9fe4aff5f4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:11.143666 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b3907ab5-3b48-46d0-97cc-aa9fe4aff5f4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:11.144416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b3907ab5-3b48-46d0-97cc-aa9fe4aff5f4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:11.144873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b3907ab5-3b48-46d0-97cc-aa9fe4aff5f4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:11.145344 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b3907ab5-3b48-46d0-97cc-aa9fe4aff5f4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:11.161859 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-b3907ab5-3b48-46d0-97cc-aa9fe4aff5f4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] HTTP exception thrown: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b3907ab5-3b48-46d0-97cc-aa9fe4aff5f4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Request method failure captured: Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 HTTP/1.1 Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MOkhlZtna41j2Y-lGyoDQsuQs1nBOgOAGA7HNPtonJ6KaI55B26wAQrSxM8bxgj35LDuzk_w6WMhL9fd4rTzLZvoHPrU5GIl8o8xHqP0q7vav6maAEbq5GwF1olu80B06DeDXAMU1IOZxFnKHcluEfRpXv6h2NrAYPZLwQbCv5pPQw Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: f3385eb4afc441ba834ec0ddc1c3fd9a Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:26:11.163753 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:26:11.166442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f3385eb4afc441ba834ec0ddc1c3fd9a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f3385eb4afc441ba834ec0ddc1c3fd9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:26:11.166442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:11.166442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: f3385eb4afc441ba834ec0ddc1c3fd9a Aug 05 07:26:11.166442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-505625477 Aug 05 07:26:11.166442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-AttachVolumeShelveTestJSON-505625477-project Aug 05 07:26:11.166442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:26:11.166442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:26:11.166442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 723cdd3baceb4f51a57df4863af99c3e Aug 05 07:26:11.166442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-AttachVolumeShelveTestJSON-505625477-project Aug 05 07:26:11.166442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:26:11.166442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:26:11.166442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'f664511a-28db-4ff6-90e9-7e2db58e94e2'} Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:26:11.167446 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. Aug 05 07:26:11.169255 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:26:11.171442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b3907ab5-3b48-46d0-97cc-aa9fe4aff5f4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] Returning 404 to user: Instance f664511a-28db-4ff6-90e9-7e2db58e94e2 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:26:11.171442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b3907ab5-3b48-46d0-97cc-aa9fe4aff5f4 tempest-AttachVolumeShelveTestJSON-505625477 tempest-AttachVolumeShelveTestJSON-505625477-project] 10.222.0.27 "GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2" status: 404 len: 111 microversion: 2.20 time: 0.036163 Aug 05 07:26:11.171442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 554/1093] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Aug 5 07:26:11 2022] GET /compute/v2.1/servers/f664511a-28db-4ff6-90e9-7e2db58e94e2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 07:26:11.249018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a96c2221-a1f6-4f50-9cd0-43b14a2300f2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:11.250105 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a96c2221-a1f6-4f50-9cd0-43b14a2300f2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:11.265760 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a96c2221-a1f6-4f50-9cd0-43b14a2300f2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:11.269812 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a96c2221-a1f6-4f50-9cd0-43b14a2300f2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:11.270588 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a96c2221-a1f6-4f50-9cd0-43b14a2300f2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:11.271878 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a96c2221-a1f6-4f50-9cd0-43b14a2300f2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:11.272749 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a96c2221-a1f6-4f50-9cd0-43b14a2300f2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:11.273526 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a96c2221-a1f6-4f50-9cd0-43b14a2300f2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:11.511876 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a96c2221-a1f6-4f50-9cd0-43b14a2300f2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:11.522003 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a96c2221-a1f6-4f50-9cd0-43b14a2300f2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.280806 Aug 05 07:26:11.522872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 540/1094] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:11 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:11.975418 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-31be825d-f28b-47f0-962d-85b664266e97 req-35036065-b255-4d63-a252-4b12764fc8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a908d4c-f340-4eac-b693-6b31a013f1a5", "tag": "8acf667b-4d18-4af9-8032-92bbfd51af89"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:26:11.985873 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-31be825d-f28b-47f0-962d-85b664266e97 req-35036065-b255-4d63-a252-4b12764fc8b0 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:11.986671 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-31be825d-f28b-47f0-962d-85b664266e97 req-35036065-b255-4d63-a252-4b12764fc8b0 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:11.987645 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-31be825d-f28b-47f0-962d-85b664266e97 req-35036065-b255-4d63-a252-4b12764fc8b0 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:12.002806 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-31be825d-f28b-47f0-962d-85b664266e97 req-35036065-b255-4d63-a252-4b12764fc8b0 service nova] Creating event network-changed:8acf667b-4d18-4af9-8032-92bbfd51af89 for instance 8a908d4c-f340-4eac-b693-6b31a013f1a5 on hv-cinder-85200 Aug 05 07:26:12.009646 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-31be825d-f28b-47f0-962d-85b664266e97 req-35036065-b255-4d63-a252-4b12764fc8b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037736 Aug 05 07:26:12.010672 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 555/1095] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:26:12.547782 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4e46d29b-743a-44cd-8b18-ae358fd90020 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:12.548861 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4e46d29b-743a-44cd-8b18-ae358fd90020 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:12.560168 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e46d29b-743a-44cd-8b18-ae358fd90020 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:12.561780 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e46d29b-743a-44cd-8b18-ae358fd90020 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:12.562308 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e46d29b-743a-44cd-8b18-ae358fd90020 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:12.563660 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e46d29b-743a-44cd-8b18-ae358fd90020 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:12.564561 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e46d29b-743a-44cd-8b18-ae358fd90020 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:12.565359 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e46d29b-743a-44cd-8b18-ae358fd90020 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:12.811353 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4e46d29b-743a-44cd-8b18-ae358fd90020 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:12.820440 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4e46d29b-743a-44cd-8b18-ae358fd90020 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.278695 Aug 05 07:26:12.821332 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 541/1096] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:12 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:13.844246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-bc5692c8-13c0-4f55-8770-984676b431c4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:13.845475 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-bc5692c8-13c0-4f55-8770-984676b431c4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:13.849105 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:13.856339 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bc5692c8-13c0-4f55-8770-984676b431c4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:13.856830 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bc5692c8-13c0-4f55-8770-984676b431c4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:13.857305 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bc5692c8-13c0-4f55-8770-984676b431c4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:13.858029 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bc5692c8-13c0-4f55-8770-984676b431c4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:13.858479 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bc5692c8-13c0-4f55-8770-984676b431c4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:13.858901 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-bc5692c8-13c0-4f55-8770-984676b431c4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:13.862852 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=93 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:14.013480 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-bc5692c8-13c0-4f55-8770-984676b431c4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:14.022802 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-bc5692c8-13c0-4f55-8770-984676b431c4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.183924 Aug 05 07:26:14.036935 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 556/1097] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:13 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:15.047071 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4307ca39-f4ec-457e-8c74-e65ea366e2f4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:15.047558 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4307ca39-f4ec-457e-8c74-e65ea366e2f4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:15.050088 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:15.056951 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4307ca39-f4ec-457e-8c74-e65ea366e2f4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:15.057644 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4307ca39-f4ec-457e-8c74-e65ea366e2f4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:15.058241 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4307ca39-f4ec-457e-8c74-e65ea366e2f4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:15.059806 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4307ca39-f4ec-457e-8c74-e65ea366e2f4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:15.060626 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4307ca39-f4ec-457e-8c74-e65ea366e2f4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:15.061301 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4307ca39-f4ec-457e-8c74-e65ea366e2f4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:15.328947 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4307ca39-f4ec-457e-8c74-e65ea366e2f4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:15.337563 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4307ca39-f4ec-457e-8c74-e65ea366e2f4 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.295379 Aug 05 07:26:15.338243 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 542/1098] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:15 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:16.370173 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f5943905-61a9-41d1-86db-0df0694645bb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:16.371051 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f5943905-61a9-41d1-86db-0df0694645bb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:16.379083 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f5943905-61a9-41d1-86db-0df0694645bb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:16.379700 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f5943905-61a9-41d1-86db-0df0694645bb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:16.380370 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f5943905-61a9-41d1-86db-0df0694645bb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:16.381428 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f5943905-61a9-41d1-86db-0df0694645bb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:16.381981 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f5943905-61a9-41d1-86db-0df0694645bb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:16.382918 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f5943905-61a9-41d1-86db-0df0694645bb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:16.564547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f5943905-61a9-41d1-86db-0df0694645bb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:16.574899 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f5943905-61a9-41d1-86db-0df0694645bb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.209604 Aug 05 07:26:16.575651 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 557/1099] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:16 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:17.599477 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-12537198-cdea-47d5-9b9a-de08d85e8a08 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:17.600032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-12537198-cdea-47d5-9b9a-de08d85e8a08 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:17.607783 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12537198-cdea-47d5-9b9a-de08d85e8a08 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:17.608274 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12537198-cdea-47d5-9b9a-de08d85e8a08 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:17.608708 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12537198-cdea-47d5-9b9a-de08d85e8a08 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:17.609454 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12537198-cdea-47d5-9b9a-de08d85e8a08 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:17.609918 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12537198-cdea-47d5-9b9a-de08d85e8a08 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:17.610337 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12537198-cdea-47d5-9b9a-de08d85e8a08 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:17.762832 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-12537198-cdea-47d5-9b9a-de08d85e8a08 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:17.773241 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-12537198-cdea-47d5-9b9a-de08d85e8a08 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.177773 Aug 05 07:26:17.773853 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 543/1100] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:17 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:18.805915 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a04c5b45-603c-4946-8fea-f974ac982a9a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:18.806530 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a04c5b45-603c-4946-8fea-f974ac982a9a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:18.813431 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a04c5b45-603c-4946-8fea-f974ac982a9a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:18.813878 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a04c5b45-603c-4946-8fea-f974ac982a9a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:18.814308 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a04c5b45-603c-4946-8fea-f974ac982a9a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:18.815014 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a04c5b45-603c-4946-8fea-f974ac982a9a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:18.815493 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a04c5b45-603c-4946-8fea-f974ac982a9a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:18.815879 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a04c5b45-603c-4946-8fea-f974ac982a9a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:18.890273 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:18.914986 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=6 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:19.008885 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a04c5b45-603c-4946-8fea-f974ac982a9a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:19.016833 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a04c5b45-603c-4946-8fea-f974ac982a9a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.215220 Aug 05 07:26:19.017455 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 558/1101] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:18 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:19.455160 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:19.649584 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-707c1041-1a8e-4454-b1d4-6ea41c15d248 req-7342dc27-254a-4207-8ec5-e2f66fd1cad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a908d4c-f340-4eac-b693-6b31a013f1a5", "name": "network-vif-plugged", "status": "completed", "tag": "8acf667b-4d18-4af9-8032-92bbfd51af89"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:26:19.660436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-707c1041-1a8e-4454-b1d4-6ea41c15d248 req-7342dc27-254a-4207-8ec5-e2f66fd1cad9 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:19.660937 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-707c1041-1a8e-4454-b1d4-6ea41c15d248 req-7342dc27-254a-4207-8ec5-e2f66fd1cad9 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:19.661372 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-707c1041-1a8e-4454-b1d4-6ea41c15d248 req-7342dc27-254a-4207-8ec5-e2f66fd1cad9 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:19.674761 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-707c1041-1a8e-4454-b1d4-6ea41c15d248 req-7342dc27-254a-4207-8ec5-e2f66fd1cad9 service nova] Creating event network-vif-plugged:8acf667b-4d18-4af9-8032-92bbfd51af89 for instance 8a908d4c-f340-4eac-b693-6b31a013f1a5 on hv-cinder-85200 Aug 05 07:26:19.681020 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-707c1041-1a8e-4454-b1d4-6ea41c15d248 req-7342dc27-254a-4207-8ec5-e2f66fd1cad9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234760 Aug 05 07:26:19.681771 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 544/1102] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:26:20.040498 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-30a73a30-bbe2-4fe3-9b10-04c23327d146 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:20.041279 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-30a73a30-bbe2-4fe3-9b10-04c23327d146 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:20.048308 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-30a73a30-bbe2-4fe3-9b10-04c23327d146 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:20.048850 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-30a73a30-bbe2-4fe3-9b10-04c23327d146 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:20.049538 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-30a73a30-bbe2-4fe3-9b10-04c23327d146 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:20.050149 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-30a73a30-bbe2-4fe3-9b10-04c23327d146 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:20.050616 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-30a73a30-bbe2-4fe3-9b10-04c23327d146 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:20.051122 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-30a73a30-bbe2-4fe3-9b10-04c23327d146 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:20.197394 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-30a73a30-bbe2-4fe3-9b10-04c23327d146 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:20.210280 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-30a73a30-bbe2-4fe3-9b10-04c23327d146 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.173970 Aug 05 07:26:20.211076 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 559/1103] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:20 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:21.233415 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d26c71ae-74b5-40a5-939c-d981dab6f312 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:21.234093 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d26c71ae-74b5-40a5-939c-d981dab6f312 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:21.241205 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d26c71ae-74b5-40a5-939c-d981dab6f312 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:21.241711 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d26c71ae-74b5-40a5-939c-d981dab6f312 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:21.242136 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d26c71ae-74b5-40a5-939c-d981dab6f312 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:21.242848 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d26c71ae-74b5-40a5-939c-d981dab6f312 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:21.243305 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d26c71ae-74b5-40a5-939c-d981dab6f312 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:21.243731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d26c71ae-74b5-40a5-939c-d981dab6f312 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:21.399418 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d26c71ae-74b5-40a5-939c-d981dab6f312 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:21.407943 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d26c71ae-74b5-40a5-939c-d981dab6f312 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.179825 Aug 05 07:26:21.408535 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 545/1104] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:21 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:22.430236 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-8a6e3c85-229e-427a-a985-bb8c56e6be03 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:22.430832 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-8a6e3c85-229e-427a-a985-bb8c56e6be03 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:22.438384 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8a6e3c85-229e-427a-a985-bb8c56e6be03 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:22.438933 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8a6e3c85-229e-427a-a985-bb8c56e6be03 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:22.439388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8a6e3c85-229e-427a-a985-bb8c56e6be03 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:22.440097 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8a6e3c85-229e-427a-a985-bb8c56e6be03 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:22.440650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8a6e3c85-229e-427a-a985-bb8c56e6be03 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:22.441164 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-8a6e3c85-229e-427a-a985-bb8c56e6be03 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:22.590409 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-8a6e3c85-229e-427a-a985-bb8c56e6be03 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:22.599186 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-8a6e3c85-229e-427a-a985-bb8c56e6be03 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.173618 Aug 05 07:26:22.599759 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 560/1105] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:22 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:23.620203 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9ce3686e-feb1-41e0-a07a-04e0fae5ad6e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:23.620828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9ce3686e-feb1-41e0-a07a-04e0fae5ad6e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:23.628004 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce3686e-feb1-41e0-a07a-04e0fae5ad6e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:23.628507 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce3686e-feb1-41e0-a07a-04e0fae5ad6e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:23.628974 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce3686e-feb1-41e0-a07a-04e0fae5ad6e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:23.629707 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce3686e-feb1-41e0-a07a-04e0fae5ad6e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:23.630149 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce3686e-feb1-41e0-a07a-04e0fae5ad6e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:23.630579 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce3686e-feb1-41e0-a07a-04e0fae5ad6e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:23.787574 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9ce3686e-feb1-41e0-a07a-04e0fae5ad6e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:23.795986 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9ce3686e-feb1-41e0-a07a-04e0fae5ad6e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.179742 Aug 05 07:26:23.796562 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 546/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:23 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:24.823869 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-cf31133c-4654-4193-be99-1b0bb8823b31 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:24.824466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-cf31133c-4654-4193-be99-1b0bb8823b31 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:24.833507 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cf31133c-4654-4193-be99-1b0bb8823b31 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:24.834143 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cf31133c-4654-4193-be99-1b0bb8823b31 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:24.834661 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cf31133c-4654-4193-be99-1b0bb8823b31 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:24.836063 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cf31133c-4654-4193-be99-1b0bb8823b31 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:24.837425 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cf31133c-4654-4193-be99-1b0bb8823b31 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:24.838119 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-cf31133c-4654-4193-be99-1b0bb8823b31 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:24.983544 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-cf31133c-4654-4193-be99-1b0bb8823b31 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:24.992287 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-cf31133c-4654-4193-be99-1b0bb8823b31 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.172352 Aug 05 07:26:24.992917 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 561/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:24 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:26.014746 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a5e2a530-b953-4ea5-91c2-a180e76001d5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:26.015347 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a5e2a530-b953-4ea5-91c2-a180e76001d5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:26.023401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5e2a530-b953-4ea5-91c2-a180e76001d5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:26.023883 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5e2a530-b953-4ea5-91c2-a180e76001d5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:26.024318 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5e2a530-b953-4ea5-91c2-a180e76001d5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:26.025078 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5e2a530-b953-4ea5-91c2-a180e76001d5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:26.025547 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5e2a530-b953-4ea5-91c2-a180e76001d5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:26.025964 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5e2a530-b953-4ea5-91c2-a180e76001d5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:26.170675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a5e2a530-b953-4ea5-91c2-a180e76001d5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:26.184430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a5e2a530-b953-4ea5-91c2-a180e76001d5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1318 microversion: 2.1 time: 0.173190 Aug 05 07:26:26.185517 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 547/1108] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:26 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:26:27.205276 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f8f1bec6-7cc8-4ec0-888c-14486bdd310d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:26:27.205879 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f8f1bec6-7cc8-4ec0-888c-14486bdd310d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:26:27.213093 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f8f1bec6-7cc8-4ec0-888c-14486bdd310d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:27.213580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f8f1bec6-7cc8-4ec0-888c-14486bdd310d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:27.214005 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f8f1bec6-7cc8-4ec0-888c-14486bdd310d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:27.214707 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f8f1bec6-7cc8-4ec0-888c-14486bdd310d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:26:27.215149 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f8f1bec6-7cc8-4ec0-888c-14486bdd310d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:26:27.215567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f8f1bec6-7cc8-4ec0-888c-14486bdd310d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:26:27.355654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f8f1bec6-7cc8-4ec0-888c-14486bdd310d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:26:27.364413 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f8f1bec6-7cc8-4ec0-888c-14486bdd310d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1507 microversion: 2.1 time: 0.163007 Aug 05 07:26:27.365075 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 562/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:26:27 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:10.183690 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1923d2ec-1933-4022-8ca5-a2bcc9d42277 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba2e825f-fd44-44f8-8a73-7ffcb6cacb42", "device": "/dev/sdb"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:27:10.186823 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1923d2ec-1933-4022-8ca5-a2bcc9d42277 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:10.189120 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=11 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:10.189961 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=60 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:10.196234 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1923d2ec-1933-4022-8ca5-a2bcc9d42277 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:10.196722 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1923d2ec-1933-4022-8ca5-a2bcc9d42277 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:10.197180 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1923d2ec-1933-4022-8ca5-a2bcc9d42277 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:10.197878 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1923d2ec-1933-4022-8ca5-a2bcc9d42277 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:10.198318 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1923d2ec-1933-4022-8ca5-a2bcc9d42277 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:10.198732 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1923d2ec-1933-4022-8ca5-a2bcc9d42277 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:10.649745 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1923d2ec-1933-4022-8ca5-a2bcc9d42277 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "POST /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469664 Aug 05 07:27:10.656136 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 548/1110] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:27:10 2022] POST /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5/os-volume_attachments => generated 194 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:27:14.255116 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-78814a99-361d-42a8-8c21-7ee11bbbacce tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:14.255748 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-78814a99-361d-42a8-8c21-7ee11bbbacce tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:14.258098 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=13 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:14.259160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=41 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:14.283993 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-78814a99-361d-42a8-8c21-7ee11bbbacce tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:14.284482 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-78814a99-361d-42a8-8c21-7ee11bbbacce tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:14.285043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-78814a99-361d-42a8-8c21-7ee11bbbacce tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:14.285930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-78814a99-361d-42a8-8c21-7ee11bbbacce tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:14.286891 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-78814a99-361d-42a8-8c21-7ee11bbbacce tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:14.287388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-78814a99-361d-42a8-8c21-7ee11bbbacce tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:14.325591 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-78814a99-361d-42a8-8c21-7ee11bbbacce tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Going to try to terminate instance {{(pid=117894) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:27:14.441539 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-78814a99-361d-42a8-8c21-7ee11bbbacce tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 204 len: 0 microversion: 2.1 time: 0.190312 Aug 05 07:27:14.442645 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 563/1111] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:27:14 2022] DELETE /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:27:14.450664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-4a6a0636-2339-494b-98a3-e2a174e5ecbc req-fed08b99-2762-4b4a-9039-a284d22f0ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45375909-399b-4df1-9ee9-5b29174c9a93", "tag": "dcba2fdc-7a5a-479c-9dad-258cf786441f"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:27:14.451285 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-781386d8-9ac8-4e06-b339-53f14647f2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:14.451950 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-781386d8-9ac8-4e06-b339-53f14647f2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:14.458582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-781386d8-9ac8-4e06-b339-53f14647f2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:14.459062 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-781386d8-9ac8-4e06-b339-53f14647f2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:14.459487 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-781386d8-9ac8-4e06-b339-53f14647f2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:14.460183 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-781386d8-9ac8-4e06-b339-53f14647f2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:14.460628 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-781386d8-9ac8-4e06-b339-53f14647f2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:14.461082 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-781386d8-9ac8-4e06-b339-53f14647f2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:14.468641 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4a6a0636-2339-494b-98a3-e2a174e5ecbc req-fed08b99-2762-4b4a-9039-a284d22f0ead service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:14.469377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4a6a0636-2339-494b-98a3-e2a174e5ecbc req-fed08b99-2762-4b4a-9039-a284d22f0ead service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:14.470133 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4a6a0636-2339-494b-98a3-e2a174e5ecbc req-fed08b99-2762-4b4a-9039-a284d22f0ead service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:14.504365 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-4a6a0636-2339-494b-98a3-e2a174e5ecbc req-fed08b99-2762-4b4a-9039-a284d22f0ead service nova] Creating event network-changed:dcba2fdc-7a5a-479c-9dad-258cf786441f for instance 45375909-399b-4df1-9ee9-5b29174c9a93 on hv-cinder-85200 Aug 05 07:27:14.510420 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-4a6a0636-2339-494b-98a3-e2a174e5ecbc req-fed08b99-2762-4b4a-9039-a284d22f0ead service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237136 Aug 05 07:27:14.511113 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 549/1112] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:27:14.636257 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-781386d8-9ac8-4e06-b339-53f14647f2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:14.647932 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-781386d8-9ac8-4e06-b339-53f14647f2da tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1577 microversion: 2.1 time: 0.200460 Aug 05 07:27:14.656941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 564/1113] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:14 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1577 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:27:15.675587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a802ab08-7308-45e5-bf53-84e1f0ca8a88 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:15.676722 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a802ab08-7308-45e5-bf53-84e1f0ca8a88 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:15.686407 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a802ab08-7308-45e5-bf53-84e1f0ca8a88 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:15.686981 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a802ab08-7308-45e5-bf53-84e1f0ca8a88 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:15.687412 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a802ab08-7308-45e5-bf53-84e1f0ca8a88 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:15.688288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a802ab08-7308-45e5-bf53-84e1f0ca8a88 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:15.688749 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a802ab08-7308-45e5-bf53-84e1f0ca8a88 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:15.689296 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a802ab08-7308-45e5-bf53-84e1f0ca8a88 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:15.848874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a802ab08-7308-45e5-bf53-84e1f0ca8a88 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:15.857261 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a802ab08-7308-45e5-bf53-84e1f0ca8a88 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1577 microversion: 2.1 time: 0.190388 Aug 05 07:27:15.857855 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 550/1114] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:15 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:16.879370 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-6f94e3fd-388a-482e-bca5-d6cd5ae39c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:16.880083 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-6f94e3fd-388a-482e-bca5-d6cd5ae39c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:16.888220 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6f94e3fd-388a-482e-bca5-d6cd5ae39c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:16.888698 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6f94e3fd-388a-482e-bca5-d6cd5ae39c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:16.889151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6f94e3fd-388a-482e-bca5-d6cd5ae39c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:16.889844 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6f94e3fd-388a-482e-bca5-d6cd5ae39c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:16.890276 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6f94e3fd-388a-482e-bca5-d6cd5ae39c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:16.890938 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-6f94e3fd-388a-482e-bca5-d6cd5ae39c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:17.058429 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-6f94e3fd-388a-482e-bca5-d6cd5ae39c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:17.066881 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-6f94e3fd-388a-482e-bca5-d6cd5ae39c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1577 microversion: 2.1 time: 0.191802 Aug 05 07:27:17.067486 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 565/1115] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:16 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:18.102567 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fa95d1f1-9b9f-42d4-952d-883da2fe7f23 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:18.103260 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fa95d1f1-9b9f-42d4-952d-883da2fe7f23 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:18.110000 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa95d1f1-9b9f-42d4-952d-883da2fe7f23 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:18.110499 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa95d1f1-9b9f-42d4-952d-883da2fe7f23 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:18.110949 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa95d1f1-9b9f-42d4-952d-883da2fe7f23 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:18.111661 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa95d1f1-9b9f-42d4-952d-883da2fe7f23 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:18.112134 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa95d1f1-9b9f-42d4-952d-883da2fe7f23 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:18.112566 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa95d1f1-9b9f-42d4-952d-883da2fe7f23 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:18.271991 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fa95d1f1-9b9f-42d4-952d-883da2fe7f23 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:18.286733 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fa95d1f1-9b9f-42d4-952d-883da2fe7f23 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1577 microversion: 2.1 time: 0.187700 Aug 05 07:27:18.288935 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 551/1116] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:18 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:19.318904 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3375680d-566a-4136-9e74-3d2f324b5be3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:19.320233 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3375680d-566a-4136-9e74-3d2f324b5be3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:19.326841 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3375680d-566a-4136-9e74-3d2f324b5be3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:19.327226 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3375680d-566a-4136-9e74-3d2f324b5be3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:19.327655 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3375680d-566a-4136-9e74-3d2f324b5be3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:19.328361 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3375680d-566a-4136-9e74-3d2f324b5be3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:19.328797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3375680d-566a-4136-9e74-3d2f324b5be3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:19.329233 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3375680d-566a-4136-9e74-3d2f324b5be3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:19.470490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3375680d-566a-4136-9e74-3d2f324b5be3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:19.482246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3375680d-566a-4136-9e74-3d2f324b5be3 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1577 microversion: 2.1 time: 0.168187 Aug 05 07:27:19.482995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 566/1117] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:19 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:20.508605 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-02f99cff-3564-49f2-941a-324fd5b1f630 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:20.509278 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-02f99cff-3564-49f2-941a-324fd5b1f630 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:20.518628 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02f99cff-3564-49f2-941a-324fd5b1f630 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:20.518628 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02f99cff-3564-49f2-941a-324fd5b1f630 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:20.518628 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02f99cff-3564-49f2-941a-324fd5b1f630 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:20.518628 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02f99cff-3564-49f2-941a-324fd5b1f630 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:20.519147 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02f99cff-3564-49f2-941a-324fd5b1f630 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:20.519598 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02f99cff-3564-49f2-941a-324fd5b1f630 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:20.669833 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-02f99cff-3564-49f2-941a-324fd5b1f630 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:20.680350 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-02f99cff-3564-49f2-941a-324fd5b1f630 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1577 microversion: 2.1 time: 0.176690 Aug 05 07:27:20.680955 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 552/1118] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:20 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:21.701200 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c1d900d2-86ae-4ac3-b60a-9bbb408386b6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:21.701906 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c1d900d2-86ae-4ac3-b60a-9bbb408386b6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:21.708433 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c1d900d2-86ae-4ac3-b60a-9bbb408386b6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:21.708985 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c1d900d2-86ae-4ac3-b60a-9bbb408386b6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:21.709395 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c1d900d2-86ae-4ac3-b60a-9bbb408386b6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:21.710098 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c1d900d2-86ae-4ac3-b60a-9bbb408386b6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:21.710543 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c1d900d2-86ae-4ac3-b60a-9bbb408386b6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:21.710966 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c1d900d2-86ae-4ac3-b60a-9bbb408386b6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:21.731691 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-0fc2e379-2842-4b78-bf58-67816a522e42 req-1e01871c-ce62-4d4e-b3e2-ee8f2d5cec8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45375909-399b-4df1-9ee9-5b29174c9a93", "name": "network-vif-unplugged", "status": "completed", "tag": "dcba2fdc-7a5a-479c-9dad-258cf786441f"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:27:21.746416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0fc2e379-2842-4b78-bf58-67816a522e42 req-1e01871c-ce62-4d4e-b3e2-ee8f2d5cec8a service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:21.747328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0fc2e379-2842-4b78-bf58-67816a522e42 req-1e01871c-ce62-4d4e-b3e2-ee8f2d5cec8a service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:21.748100 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0fc2e379-2842-4b78-bf58-67816a522e42 req-1e01871c-ce62-4d4e-b3e2-ee8f2d5cec8a service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:21.764724 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-0fc2e379-2842-4b78-bf58-67816a522e42 req-1e01871c-ce62-4d4e-b3e2-ee8f2d5cec8a service nova] Creating event network-vif-unplugged:dcba2fdc-7a5a-479c-9dad-258cf786441f for instance 45375909-399b-4df1-9ee9-5b29174c9a93 on hv-cinder-85200 Aug 05 07:27:21.777983 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-0fc2e379-2842-4b78-bf58-67816a522e42 req-1e01871c-ce62-4d4e-b3e2-ee8f2d5cec8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049813 Aug 05 07:27:21.779771 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 553/1119] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:27:21.926499 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c1d900d2-86ae-4ac3-b60a-9bbb408386b6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:21.940558 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c1d900d2-86ae-4ac3-b60a-9bbb408386b6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1577 microversion: 2.1 time: 0.243426 Aug 05 07:27:21.941338 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 567/1120] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:21 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1577 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:22.964331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-642db235-7c07-4605-b66b-b4e06b50b387 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:22.965111 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-642db235-7c07-4605-b66b-b4e06b50b387 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:22.973197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-642db235-7c07-4605-b66b-b4e06b50b387 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:22.973700 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-642db235-7c07-4605-b66b-b4e06b50b387 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:22.974129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-642db235-7c07-4605-b66b-b4e06b50b387 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:22.974849 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-642db235-7c07-4605-b66b-b4e06b50b387 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:22.975307 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-642db235-7c07-4605-b66b-b4e06b50b387 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:22.975715 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-642db235-7c07-4605-b66b-b4e06b50b387 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:23.136691 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-642db235-7c07-4605-b66b-b4e06b50b387 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:23.147229 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-642db235-7c07-4605-b66b-b4e06b50b387 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1458 microversion: 2.1 time: 0.187657 Aug 05 07:27:23.148257 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 554/1121] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:22 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1458 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:23.401474 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-a9a9ca15-c7b8-4e8b-b6a0-2e58e1b88ff9 req-79f7edb5-d32d-4181-a063-85730a3b7e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45375909-399b-4df1-9ee9-5b29174c9a93", "name": "network-vif-deleted", "tag": "dcba2fdc-7a5a-479c-9dad-258cf786441f"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:27:23.411880 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-a9a9ca15-c7b8-4e8b-b6a0-2e58e1b88ff9 req-79f7edb5-d32d-4181-a063-85730a3b7e49 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:23.412460 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-a9a9ca15-c7b8-4e8b-b6a0-2e58e1b88ff9 req-79f7edb5-d32d-4181-a063-85730a3b7e49 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:23.412987 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-a9a9ca15-c7b8-4e8b-b6a0-2e58e1b88ff9 req-79f7edb5-d32d-4181-a063-85730a3b7e49 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:23.424308 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-a9a9ca15-c7b8-4e8b-b6a0-2e58e1b88ff9 req-79f7edb5-d32d-4181-a063-85730a3b7e49 service nova] Creating event network-vif-deleted:dcba2fdc-7a5a-479c-9dad-258cf786441f for instance 45375909-399b-4df1-9ee9-5b29174c9a93 on hv-cinder-85200 Aug 05 07:27:23.429454 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-a9a9ca15-c7b8-4e8b-b6a0-2e58e1b88ff9 req-79f7edb5-d32d-4181-a063-85730a3b7e49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031560 Aug 05 07:27:23.430075 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 568/1122] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:27:24.170022 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:24.170633 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:24.178097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:24.178580 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:24.178992 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:24.179675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:24.180116 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:24.180529 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:24.212400 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:24.212930 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:24.213360 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:24.213796 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lazy-loading 'fault' on Instance uuid 45375909-399b-4df1-9ee9-5b29174c9a93 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:27:24.261946 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:24.268322 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-571ba454-add1-49b8-8cac-f28741b9a6cc tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 200 len: 1231 microversion: 2.1 time: 0.102547 Aug 05 07:27:24.268919 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 555/1123] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:24 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:25.294689 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-784db578-c441-4b39-ac81-eeaf33a5151e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:25.295903 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-784db578-c441-4b39-ac81-eeaf33a5151e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 45375909-399b-4df1-9ee9-5b29174c9a93] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:25.305795 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-784db578-c441-4b39-ac81-eeaf33a5151e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:25.306490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-784db578-c441-4b39-ac81-eeaf33a5151e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:25.307041 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-784db578-c441-4b39-ac81-eeaf33a5151e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:25.308023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-784db578-c441-4b39-ac81-eeaf33a5151e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:25.308727 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-784db578-c441-4b39-ac81-eeaf33a5151e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:25.309407 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-784db578-c441-4b39-ac81-eeaf33a5151e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:25.329292 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-784db578-c441-4b39-ac81-eeaf33a5151e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] HTTP exception thrown: Instance 45375909-399b-4df1-9ee9-5b29174c9a93 could not be found. Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-784db578-c441-4b39-ac81-eeaf33a5151e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Request method failure captured: Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 HTTP/1.1 Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MPjnss623grFw3OIsxvZyPD5d8DyUIJ9IvlHez0UG_G_JbTgoBftEKBd_N4FPQc5BXdwd3FB4TNCJbLP1EHNenLcBf1QKCl2wyv6M5a2nhx962v4gzpTEHdQ2X6Ig_NG89llIU4w4nIQO3MgNwg4AXUZuq3Wx8Qk0y83rDyfIdZhLg Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 2720b0660de14a19a05ef57efaa01cd8 Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:27:25.330980 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:27:25.332797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2720b0660de14a19a05ef57efaa01cd8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:27:25.332797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:27:25.332797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 2720b0660de14a19a05ef57efaa01cd8 Aug 05 07:27:25.332797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:27:25.332797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-TestVolumeBootPattern-1137302503-project Aug 05 07:27:25.332797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:27:25.332797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:27:25.332797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 43ef613541cb4fd49faa3a3cec1a58c8 Aug 05 07:27:25.332797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-TestVolumeBootPattern-1137302503-project Aug 05 07:27:25.332797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:27:25.332797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance 45375909-399b-4df1-9ee9-5b29174c9a93 could not be found. Aug 05 07:27:25.332797 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': '45375909-399b-4df1-9ee9-5b29174c9a93'} Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45375909-399b-4df1-9ee9-5b29174c9a93 could not be found. Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:27:25.337567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45375909-399b-4df1-9ee9-5b29174c9a93 could not be found. Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45375909-399b-4df1-9ee9-5b29174c9a93 could not be found. Aug 05 07:27:25.340002 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:25.343108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-784db578-c441-4b39-ac81-eeaf33a5151e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Returning 404 to user: Instance 45375909-399b-4df1-9ee9-5b29174c9a93 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:27:25.343108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-784db578-c441-4b39-ac81-eeaf33a5151e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93" status: 404 len: 111 microversion: 2.1 time: 0.046144 Aug 05 07:27:25.343108 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 569/1124] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:25 2022] GET /compute/v2.1/servers/45375909-399b-4df1-9ee9-5b29174c9a93 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 07:27:31.032562 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1392208001", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:27:31.089872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] validate_networks() for None {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:27:31.396590 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:27:31.397051 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:27:31.397523 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:27:31.397953 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:27:31.398366 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:27:31.408096 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:31.408557 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:31.409055 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:31.409791 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:31.410236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:31.410637 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:31.428212 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Getting quotas for project d0d79fa7d5aa4f3ca24ea285ea9fe273. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:27:31.433972 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Getting quotas for user 237c36ca81e34f87870b71d2e80cd37d and project d0d79fa7d5aa4f3ca24ea285ea9fe273. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:27:31.445495 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:27:31.447798 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:27:31.505081 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9cbb5e55-2d4f-4091-a27b-0fe8c1d82c1b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.476369 Aug 05 07:27:31.505746 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 556/1125] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 07:27:31.517061 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-890fde9e-1cbc-4512-86cc-59b214b34e47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:31.517725 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-890fde9e-1cbc-4512-86cc-59b214b34e47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:31.575959 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-890fde9e-1cbc-4512-86cc-59b214b34e47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:31.586454 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-890fde9e-1cbc-4512-86cc-59b214b34e47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1215 microversion: 2.1 time: 0.073280 Aug 05 07:27:31.587111 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 570/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:31 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:32.611043 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3829cbd7-965c-40a6-bea2-7aa7833b9eb9 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:32.611628 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3829cbd7-965c-40a6-bea2-7aa7833b9eb9 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:32.618671 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3829cbd7-965c-40a6-bea2-7aa7833b9eb9 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:32.619132 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3829cbd7-965c-40a6-bea2-7aa7833b9eb9 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:32.619571 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3829cbd7-965c-40a6-bea2-7aa7833b9eb9 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:32.620272 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3829cbd7-965c-40a6-bea2-7aa7833b9eb9 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:32.620715 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3829cbd7-965c-40a6-bea2-7aa7833b9eb9 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:32.621172 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3829cbd7-965c-40a6-bea2-7aa7833b9eb9 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:32.690839 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3829cbd7-965c-40a6-bea2-7aa7833b9eb9 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:32.701382 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3829cbd7-965c-40a6-bea2-7aa7833b9eb9 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1219 microversion: 2.1 time: 0.094608 Aug 05 07:27:32.702184 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 557/1127] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:32 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:33.722558 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7fdce061-bd88-4115-9717-2f1306857cb7 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:33.723265 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7fdce061-bd88-4115-9717-2f1306857cb7 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:33.730198 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fdce061-bd88-4115-9717-2f1306857cb7 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:33.730680 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fdce061-bd88-4115-9717-2f1306857cb7 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:33.731105 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fdce061-bd88-4115-9717-2f1306857cb7 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:33.731798 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fdce061-bd88-4115-9717-2f1306857cb7 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:33.732251 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fdce061-bd88-4115-9717-2f1306857cb7 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:33.732671 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7fdce061-bd88-4115-9717-2f1306857cb7 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:33.804933 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7fdce061-bd88-4115-9717-2f1306857cb7 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:33.814740 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7fdce061-bd88-4115-9717-2f1306857cb7 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1219 microversion: 2.1 time: 0.095944 Aug 05 07:27:33.815379 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 571/1128] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:33 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:34.838503 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9926c169-c61d-401f-be52-8bc3eb477044 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:34.839204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9926c169-c61d-401f-be52-8bc3eb477044 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:34.846308 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9926c169-c61d-401f-be52-8bc3eb477044 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:34.846771 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9926c169-c61d-401f-be52-8bc3eb477044 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:34.847203 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9926c169-c61d-401f-be52-8bc3eb477044 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:34.847926 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9926c169-c61d-401f-be52-8bc3eb477044 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:34.848405 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9926c169-c61d-401f-be52-8bc3eb477044 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:34.848850 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9926c169-c61d-401f-be52-8bc3eb477044 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:34.929083 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9926c169-c61d-401f-be52-8bc3eb477044 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:34.937223 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9926c169-c61d-401f-be52-8bc3eb477044 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1219 microversion: 2.1 time: 0.103739 Aug 05 07:27:34.937796 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 558/1129] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:34 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:35.958649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a3cd1395-db07-49e3-9bf6-1c9596fd8cab tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:35.959415 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a3cd1395-db07-49e3-9bf6-1c9596fd8cab tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:35.966258 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a3cd1395-db07-49e3-9bf6-1c9596fd8cab tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:35.966761 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a3cd1395-db07-49e3-9bf6-1c9596fd8cab tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:35.967172 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a3cd1395-db07-49e3-9bf6-1c9596fd8cab tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:35.967876 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a3cd1395-db07-49e3-9bf6-1c9596fd8cab tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:35.968329 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a3cd1395-db07-49e3-9bf6-1c9596fd8cab tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:35.968750 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a3cd1395-db07-49e3-9bf6-1c9596fd8cab tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:36.046056 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a3cd1395-db07-49e3-9bf6-1c9596fd8cab tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:36.054860 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a3cd1395-db07-49e3-9bf6-1c9596fd8cab tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1273 microversion: 2.1 time: 0.100102 Aug 05 07:27:36.055447 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 572/1130] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:35 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:37.077441 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7e0b800b-b90c-4818-b24e-c085e4684f69 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:37.078043 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7e0b800b-b90c-4818-b24e-c085e4684f69 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:37.085124 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e0b800b-b90c-4818-b24e-c085e4684f69 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:37.085739 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e0b800b-b90c-4818-b24e-c085e4684f69 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:37.086180 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e0b800b-b90c-4818-b24e-c085e4684f69 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:37.086886 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e0b800b-b90c-4818-b24e-c085e4684f69 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:37.087344 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e0b800b-b90c-4818-b24e-c085e4684f69 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:37.087767 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7e0b800b-b90c-4818-b24e-c085e4684f69 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:37.369781 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-1b8369e1-6613-4009-96eb-f0012938e160 req-305e0521-c7de-4d6d-bacf-85b97c754132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ebb7227-f885-4ecd-9750-d0fdf1890a38", "tag": "65bde22a-cc07-4cd6-a11a-68aa531ab57a"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:27:37.383327 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-1b8369e1-6613-4009-96eb-f0012938e160 req-305e0521-c7de-4d6d-bacf-85b97c754132 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:37.383816 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-1b8369e1-6613-4009-96eb-f0012938e160 req-305e0521-c7de-4d6d-bacf-85b97c754132 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:37.384244 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-1b8369e1-6613-4009-96eb-f0012938e160 req-305e0521-c7de-4d6d-bacf-85b97c754132 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:37.399171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-1b8369e1-6613-4009-96eb-f0012938e160 req-305e0521-c7de-4d6d-bacf-85b97c754132 service nova] Creating event network-changed:65bde22a-cc07-4cd6-a11a-68aa531ab57a for instance 8ebb7227-f885-4ecd-9750-d0fdf1890a38 on hv-cinder-85200 Aug 05 07:27:37.405204 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-1b8369e1-6613-4009-96eb-f0012938e160 req-305e0521-c7de-4d6d-bacf-85b97c754132 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039044 Aug 05 07:27:37.407355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 573/1131] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:27:37.573366 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7e0b800b-b90c-4818-b24e-c085e4684f69 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:37.581630 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7e0b800b-b90c-4818-b24e-c085e4684f69 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1315 microversion: 2.1 time: 0.508391 Aug 05 07:27:37.582207 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 559/1132] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:37 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:38.273580 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4e07e8f0-47c0-4898-96ac-2136772ebc2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:38.274277 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4e07e8f0-47c0-4898-96ac-2136772ebc2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:38.275610 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-919cbab9-21f0-400b-bfc0-7f359cc913e9 req-4d8f37f8-39a6-4f89-a23e-9d77d8355f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2739a6-db43-428a-9342-53229c6530fb", "tag": "f7adc9e7-faaa-401c-97e8-c38dbcabbbf9"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:27:38.288280 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e07e8f0-47c0-4898-96ac-2136772ebc2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:38.288588 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e07e8f0-47c0-4898-96ac-2136772ebc2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:38.289259 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e07e8f0-47c0-4898-96ac-2136772ebc2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:38.290055 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e07e8f0-47c0-4898-96ac-2136772ebc2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:38.290659 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e07e8f0-47c0-4898-96ac-2136772ebc2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:38.291225 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-919cbab9-21f0-400b-bfc0-7f359cc913e9 req-4d8f37f8-39a6-4f89-a23e-9d77d8355f1f service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:38.291458 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4e07e8f0-47c0-4898-96ac-2136772ebc2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:38.291793 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-919cbab9-21f0-400b-bfc0-7f359cc913e9 req-4d8f37f8-39a6-4f89-a23e-9d77d8355f1f service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:38.292327 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-919cbab9-21f0-400b-bfc0-7f359cc913e9 req-4d8f37f8-39a6-4f89-a23e-9d77d8355f1f service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:38.305041 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-919cbab9-21f0-400b-bfc0-7f359cc913e9 req-4d8f37f8-39a6-4f89-a23e-9d77d8355f1f service nova] Creating event network-changed:f7adc9e7-faaa-401c-97e8-c38dbcabbbf9 for instance 5b2739a6-db43-428a-9342-53229c6530fb on hv-cinder-85200 Aug 05 07:27:38.310932 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-919cbab9-21f0-400b-bfc0-7f359cc913e9 req-4d8f37f8-39a6-4f89-a23e-9d77d8355f1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047923 Aug 05 07:27:38.311650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 560/1133] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:27:38.324584 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4e07e8f0-47c0-4898-96ac-2136772ebc2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Going to try to terminate instance {{(pid=117894) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:27:38.412571 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4e07e8f0-47c0-4898-96ac-2136772ebc2e tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 204 len: 0 microversion: 2.1 time: 0.151227 Aug 05 07:27:38.413565 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 574/1134] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:27:38 2022] DELETE /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 07:27:38.422664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e5367bda-6562-4f27-8fce-ce9cde41eac2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:38.423356 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e5367bda-6562-4f27-8fce-ce9cde41eac2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:38.430256 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e5367bda-6562-4f27-8fce-ce9cde41eac2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:38.430746 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e5367bda-6562-4f27-8fce-ce9cde41eac2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:38.431179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e5367bda-6562-4f27-8fce-ce9cde41eac2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:38.431882 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e5367bda-6562-4f27-8fce-ce9cde41eac2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:38.432330 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e5367bda-6562-4f27-8fce-ce9cde41eac2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:38.432743 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e5367bda-6562-4f27-8fce-ce9cde41eac2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:38.589035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e5367bda-6562-4f27-8fce-ce9cde41eac2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:38.598933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e5367bda-6562-4f27-8fce-ce9cde41eac2 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1576 microversion: 2.1 time: 0.180515 Aug 05 07:27:38.599662 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 561/1135] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:38 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:27:38.603545 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-95da4393-dd0d-4485-9f5e-191adf63da8b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:38.604410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-95da4393-dd0d-4485-9f5e-191adf63da8b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:38.610515 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95da4393-dd0d-4485-9f5e-191adf63da8b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:38.611217 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95da4393-dd0d-4485-9f5e-191adf63da8b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:38.611655 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95da4393-dd0d-4485-9f5e-191adf63da8b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:38.612361 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95da4393-dd0d-4485-9f5e-191adf63da8b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:38.612817 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95da4393-dd0d-4485-9f5e-191adf63da8b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:38.613282 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-95da4393-dd0d-4485-9f5e-191adf63da8b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:38.767267 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-95da4393-dd0d-4485-9f5e-191adf63da8b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:38.775344 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-95da4393-dd0d-4485-9f5e-191adf63da8b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1315 microversion: 2.1 time: 0.176771 Aug 05 07:27:38.775923 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 575/1136] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:38 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:39.621232 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3b266ca0-eb0a-440c-9ac5-e1ba497fbf6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:39.621824 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3b266ca0-eb0a-440c-9ac5-e1ba497fbf6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:39.628800 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3b266ca0-eb0a-440c-9ac5-e1ba497fbf6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:39.629366 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3b266ca0-eb0a-440c-9ac5-e1ba497fbf6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:39.629837 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3b266ca0-eb0a-440c-9ac5-e1ba497fbf6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:39.630681 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3b266ca0-eb0a-440c-9ac5-e1ba497fbf6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:39.631156 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3b266ca0-eb0a-440c-9ac5-e1ba497fbf6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:39.632018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3b266ca0-eb0a-440c-9ac5-e1ba497fbf6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:39.778683 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3b266ca0-eb0a-440c-9ac5-e1ba497fbf6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:39.792870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3b266ca0-eb0a-440c-9ac5-e1ba497fbf6b tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1576 microversion: 2.1 time: 0.175675 Aug 05 07:27:39.793490 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 562/1137] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:39 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:39.799419 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1cd26ebc-82e6-483b-83be-9084076f1f47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:39.800297 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1cd26ebc-82e6-483b-83be-9084076f1f47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:39.809508 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1cd26ebc-82e6-483b-83be-9084076f1f47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:39.810125 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1cd26ebc-82e6-483b-83be-9084076f1f47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:39.810769 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1cd26ebc-82e6-483b-83be-9084076f1f47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:39.812003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1cd26ebc-82e6-483b-83be-9084076f1f47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:39.812558 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1cd26ebc-82e6-483b-83be-9084076f1f47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:39.813181 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1cd26ebc-82e6-483b-83be-9084076f1f47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:39.967283 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-1cd26ebc-82e6-483b-83be-9084076f1f47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:39.975122 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1cd26ebc-82e6-483b-83be-9084076f1f47 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1315 microversion: 2.1 time: 0.181551 Aug 05 07:27:39.975758 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 576/1138] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:39 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:27:40.819378 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-01941b0a-de3c-40bb-ab71-779f1b762f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:40.820205 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-01941b0a-de3c-40bb-ab71-779f1b762f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:40.822577 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:40.828332 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01941b0a-de3c-40bb-ab71-779f1b762f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:40.828820 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01941b0a-de3c-40bb-ab71-779f1b762f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:40.829288 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01941b0a-de3c-40bb-ab71-779f1b762f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:40.829998 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01941b0a-de3c-40bb-ab71-779f1b762f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:40.830449 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01941b0a-de3c-40bb-ab71-779f1b762f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:40.830869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01941b0a-de3c-40bb-ab71-779f1b762f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:40.836149 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:40.977330 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-01941b0a-de3c-40bb-ab71-779f1b762f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:40.985424 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-01941b0a-de3c-40bb-ab71-779f1b762f32 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1576 microversion: 2.1 time: 0.170189 Aug 05 07:27:40.986038 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 563/1139] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:40 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:27:40.996269 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d036152f-53ef-4b49-9048-fcbf2a289050 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:40.996960 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d036152f-53ef-4b49-9048-fcbf2a289050 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:41.004516 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d036152f-53ef-4b49-9048-fcbf2a289050 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:41.005033 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d036152f-53ef-4b49-9048-fcbf2a289050 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:41.005470 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d036152f-53ef-4b49-9048-fcbf2a289050 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:41.006237 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d036152f-53ef-4b49-9048-fcbf2a289050 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:41.007019 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d036152f-53ef-4b49-9048-fcbf2a289050 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:41.007470 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d036152f-53ef-4b49-9048-fcbf2a289050 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:41.152645 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d036152f-53ef-4b49-9048-fcbf2a289050 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:41.160664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d036152f-53ef-4b49-9048-fcbf2a289050 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1315 microversion: 2.1 time: 0.168419 Aug 05 07:27:41.161277 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 577/1140] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:40 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:42.008537 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-11dbf6e7-4715-4c4a-86dd-32d450ebad8d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:42.009326 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-11dbf6e7-4715-4c4a-86dd-32d450ebad8d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:42.011386 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:42.012276 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:42.019027 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11dbf6e7-4715-4c4a-86dd-32d450ebad8d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:42.019581 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11dbf6e7-4715-4c4a-86dd-32d450ebad8d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:42.020059 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11dbf6e7-4715-4c4a-86dd-32d450ebad8d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:42.020767 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11dbf6e7-4715-4c4a-86dd-32d450ebad8d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:42.021248 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11dbf6e7-4715-4c4a-86dd-32d450ebad8d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:42.021675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-11dbf6e7-4715-4c4a-86dd-32d450ebad8d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:42.167046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-11dbf6e7-4715-4c4a-86dd-32d450ebad8d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:42.175187 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-11dbf6e7-4715-4c4a-86dd-32d450ebad8d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1458 microversion: 2.1 time: 0.171141 Aug 05 07:27:42.180944 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 564/1141] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:42 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1458 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:42.183724 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-52ba4fbe-d106-4d29-8a9f-1662e9545986 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:42.184377 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-52ba4fbe-d106-4d29-8a9f-1662e9545986 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:42.186385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:42.194286 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52ba4fbe-d106-4d29-8a9f-1662e9545986 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:42.194777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52ba4fbe-d106-4d29-8a9f-1662e9545986 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:42.195212 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52ba4fbe-d106-4d29-8a9f-1662e9545986 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:42.195938 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52ba4fbe-d106-4d29-8a9f-1662e9545986 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:42.196389 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52ba4fbe-d106-4d29-8a9f-1662e9545986 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:42.196809 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-52ba4fbe-d106-4d29-8a9f-1662e9545986 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:42.355382 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-52ba4fbe-d106-4d29-8a9f-1662e9545986 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:42.363083 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-52ba4fbe-d106-4d29-8a9f-1662e9545986 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1315 microversion: 2.1 time: 0.184731 Aug 05 07:27:42.363659 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 578/1142] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:42 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:27:43.198734 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-79254366-c00d-454a-960d-bab5ef3d2a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:43.199364 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-79254366-c00d-454a-960d-bab5ef3d2a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:43.209091 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-79254366-c00d-454a-960d-bab5ef3d2a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:43.209770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-79254366-c00d-454a-960d-bab5ef3d2a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:43.210480 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-79254366-c00d-454a-960d-bab5ef3d2a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:43.211192 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-79254366-c00d-454a-960d-bab5ef3d2a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:43.211659 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-79254366-c00d-454a-960d-bab5ef3d2a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:43.212071 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-79254366-c00d-454a-960d-bab5ef3d2a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:43.355888 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-79254366-c00d-454a-960d-bab5ef3d2a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:43.364071 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-79254366-c00d-454a-960d-bab5ef3d2a71 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1458 microversion: 2.1 time: 0.171144 Aug 05 07:27:43.364642 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 565/1143] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:43 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1458 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:27:43.384344 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-290d6414-ac3c-4c3a-8a69-aee7feb59b32 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:43.384991 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-290d6414-ac3c-4c3a-8a69-aee7feb59b32 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:43.392072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-290d6414-ac3c-4c3a-8a69-aee7feb59b32 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:43.392552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-290d6414-ac3c-4c3a-8a69-aee7feb59b32 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:43.393045 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-290d6414-ac3c-4c3a-8a69-aee7feb59b32 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:43.393761 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-290d6414-ac3c-4c3a-8a69-aee7feb59b32 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:43.394211 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-290d6414-ac3c-4c3a-8a69-aee7feb59b32 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:43.394636 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-290d6414-ac3c-4c3a-8a69-aee7feb59b32 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:43.398942 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:43.539705 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-290d6414-ac3c-4c3a-8a69-aee7feb59b32 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:43.547771 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-290d6414-ac3c-4c3a-8a69-aee7feb59b32 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1315 microversion: 2.1 time: 0.167734 Aug 05 07:27:43.548348 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 579/1144] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:43 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:44.387505 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-72bd1f17-b5f5-472c-bc52-59951205f760 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:44.388198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-72bd1f17-b5f5-472c-bc52-59951205f760 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:44.395035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-72bd1f17-b5f5-472c-bc52-59951205f760 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:44.395517 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-72bd1f17-b5f5-472c-bc52-59951205f760 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:44.395946 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-72bd1f17-b5f5-472c-bc52-59951205f760 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:44.396641 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-72bd1f17-b5f5-472c-bc52-59951205f760 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:44.397135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-72bd1f17-b5f5-472c-bc52-59951205f760 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:44.397559 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-72bd1f17-b5f5-472c-bc52-59951205f760 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:44.543326 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-72bd1f17-b5f5-472c-bc52-59951205f760 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:44.554553 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-72bd1f17-b5f5-472c-bc52-59951205f760 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1458 microversion: 2.1 time: 0.171685 Aug 05 07:27:44.555115 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 566/1145] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:44 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1458 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:44.570201 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-e16caa9d-37bf-4e86-981e-1fbc72eb5278 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:44.570861 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-e16caa9d-37bf-4e86-981e-1fbc72eb5278 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:44.574488 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:44.583013 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e16caa9d-37bf-4e86-981e-1fbc72eb5278 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:44.583652 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e16caa9d-37bf-4e86-981e-1fbc72eb5278 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:44.584246 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e16caa9d-37bf-4e86-981e-1fbc72eb5278 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:44.585389 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e16caa9d-37bf-4e86-981e-1fbc72eb5278 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:44.585844 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e16caa9d-37bf-4e86-981e-1fbc72eb5278 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:44.586269 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-e16caa9d-37bf-4e86-981e-1fbc72eb5278 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:44.741151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-e16caa9d-37bf-4e86-981e-1fbc72eb5278 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:44.749138 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-e16caa9d-37bf-4e86-981e-1fbc72eb5278 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1315 microversion: 2.1 time: 0.184935 Aug 05 07:27:44.749697 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 580/1146] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:44 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:45.349856 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-d8a370ca-7791-43b6-aaed-970e2c869c14 req-1e8d4003-7930-4fe8-abf6-a91b6a25c2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2739a6-db43-428a-9342-53229c6530fb", "name": "network-vif-unplugged", "status": "completed", "tag": "f7adc9e7-faaa-401c-97e8-c38dbcabbbf9"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:27:45.360229 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d8a370ca-7791-43b6-aaed-970e2c869c14 req-1e8d4003-7930-4fe8-abf6-a91b6a25c2be service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:45.360679 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d8a370ca-7791-43b6-aaed-970e2c869c14 req-1e8d4003-7930-4fe8-abf6-a91b6a25c2be service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:45.361439 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d8a370ca-7791-43b6-aaed-970e2c869c14 req-1e8d4003-7930-4fe8-abf6-a91b6a25c2be service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:45.376097 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-d8a370ca-7791-43b6-aaed-970e2c869c14 req-1e8d4003-7930-4fe8-abf6-a91b6a25c2be service nova] Creating event network-vif-unplugged:f7adc9e7-faaa-401c-97e8-c38dbcabbbf9 for instance 5b2739a6-db43-428a-9342-53229c6530fb on hv-cinder-85200 Aug 05 07:27:45.382213 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-d8a370ca-7791-43b6-aaed-970e2c869c14 req-1e8d4003-7930-4fe8-abf6-a91b6a25c2be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036495 Aug 05 07:27:45.382818 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 567/1147] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:27:45.581230 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-728e3f30-6a30-49a6-bb25-53e5b28c874a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:45.581786 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-728e3f30-6a30-49a6-bb25-53e5b28c874a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:45.590416 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-728e3f30-6a30-49a6-bb25-53e5b28c874a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:45.591080 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-728e3f30-6a30-49a6-bb25-53e5b28c874a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:45.591571 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-728e3f30-6a30-49a6-bb25-53e5b28c874a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:45.592365 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-728e3f30-6a30-49a6-bb25-53e5b28c874a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:45.592875 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-728e3f30-6a30-49a6-bb25-53e5b28c874a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:45.593392 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-728e3f30-6a30-49a6-bb25-53e5b28c874a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:45.770958 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5f9a7726-864e-4051-95cb-98e98d14bb38 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:45.771964 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5f9a7726-864e-4051-95cb-98e98d14bb38 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:45.780531 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5f9a7726-864e-4051-95cb-98e98d14bb38 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:45.781027 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5f9a7726-864e-4051-95cb-98e98d14bb38 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:45.781683 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5f9a7726-864e-4051-95cb-98e98d14bb38 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:45.782459 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5f9a7726-864e-4051-95cb-98e98d14bb38 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:45.782911 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5f9a7726-864e-4051-95cb-98e98d14bb38 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:45.783427 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5f9a7726-864e-4051-95cb-98e98d14bb38 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:45.793676 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-728e3f30-6a30-49a6-bb25-53e5b28c874a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:45.802208 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-728e3f30-6a30-49a6-bb25-53e5b28c874a tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1458 microversion: 2.1 time: 0.225345 Aug 05 07:27:45.802988 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 581/1148] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:45 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1458 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:45.928551 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5f9a7726-864e-4051-95cb-98e98d14bb38 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:45.936748 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5f9a7726-864e-4051-95cb-98e98d14bb38 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1315 microversion: 2.1 time: 0.170980 Aug 05 07:27:45.937351 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 568/1149] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:45 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:27:45.960650 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-91edc6c5-e235-4d7c-bb3a-a5d3e585d436 req-708a3c0e-f617-4ef0-8554-b214d1a34db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2739a6-db43-428a-9342-53229c6530fb", "name": "network-vif-deleted", "tag": "f7adc9e7-faaa-401c-97e8-c38dbcabbbf9"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:27:45.970871 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-91edc6c5-e235-4d7c-bb3a-a5d3e585d436 req-708a3c0e-f617-4ef0-8554-b214d1a34db3 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:45.972127 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-91edc6c5-e235-4d7c-bb3a-a5d3e585d436 req-708a3c0e-f617-4ef0-8554-b214d1a34db3 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:45.972547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-91edc6c5-e235-4d7c-bb3a-a5d3e585d436 req-708a3c0e-f617-4ef0-8554-b214d1a34db3 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:45.985509 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-91edc6c5-e235-4d7c-bb3a-a5d3e585d436 req-708a3c0e-f617-4ef0-8554-b214d1a34db3 service nova] Creating event network-vif-deleted:f7adc9e7-faaa-401c-97e8-c38dbcabbbf9 for instance 5b2739a6-db43-428a-9342-53229c6530fb on hv-cinder-85200 Aug 05 07:27:45.991767 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-91edc6c5-e235-4d7c-bb3a-a5d3e585d436 req-708a3c0e-f617-4ef0-8554-b214d1a34db3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035060 Aug 05 07:27:45.992856 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 582/1150] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:27:46.236432 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-97dd0448-74e9-4a5b-ab8b-74b835b1a564 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:46.236958 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-97dd0448-74e9-4a5b-ab8b-74b835b1a564 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:46.243623 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97dd0448-74e9-4a5b-ab8b-74b835b1a564 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:46.244154 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97dd0448-74e9-4a5b-ab8b-74b835b1a564 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:46.244556 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97dd0448-74e9-4a5b-ab8b-74b835b1a564 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:46.245329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97dd0448-74e9-4a5b-ab8b-74b835b1a564 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:46.245779 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97dd0448-74e9-4a5b-ab8b-74b835b1a564 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:46.246198 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97dd0448-74e9-4a5b-ab8b-74b835b1a564 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:46.338667 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-97dd0448-74e9-4a5b-ab8b-74b835b1a564 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lazy-loading 'services' on Instance uuid 8a908d4c-f340-4eac-b693-6b31a013f1a5 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:27:46.420620 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-97dd0448-74e9-4a5b-ab8b-74b835b1a564 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5/os-volume_attachments/ba2e825f-fd44-44f8-8a73-7ffcb6cacb42" status: 202 len: 0 microversion: 2.1 time: 0.187895 Aug 05 07:27:46.421861 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 569/1151] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 5 07:27:46 2022] DELETE /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5/os-volume_attachments/ba2e825f-fd44-44f8-8a73-7ffcb6cacb42 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:27:46.824746 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:46.825548 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:46.831895 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:46.832370 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:46.832801 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:46.833521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:46.833962 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:46.834378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:46.878631 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:46.879100 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:46.879922 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:46.880374 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lazy-loading 'fault' on Instance uuid 5b2739a6-db43-428a-9342-53229c6530fb {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:27:46.926691 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ef613541cb4fd49faa3a3cec1a58c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2720b0660de14a19a05ef57efaa01cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:46.934606 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3f2e3c06-059b-47d7-b4d7-de5ca2f79b57 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 200 len: 1231 microversion: 2.1 time: 0.114556 Aug 05 07:27:46.935179 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 583/1152] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:46 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 1231 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:46.961563 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-08a52e81-5822-4803-a25c-c692ea792e79 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:46.962260 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-08a52e81-5822-4803-a25c-c692ea792e79 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:46.969273 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-08a52e81-5822-4803-a25c-c692ea792e79 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:46.969731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-08a52e81-5822-4803-a25c-c692ea792e79 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:46.970162 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-08a52e81-5822-4803-a25c-c692ea792e79 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:46.970861 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-08a52e81-5822-4803-a25c-c692ea792e79 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:46.971308 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-08a52e81-5822-4803-a25c-c692ea792e79 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:46.971727 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-08a52e81-5822-4803-a25c-c692ea792e79 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:47.111330 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-08a52e81-5822-4803-a25c-c692ea792e79 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:47.119528 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-08a52e81-5822-4803-a25c-c692ea792e79 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1315 microversion: 2.1 time: 0.164847 Aug 05 07:27:47.120095 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 570/1153] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:46 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:47.469943 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-1703f9c5-a962-499b-90a0-820d0d4fada0 req-4e41e3e8-cdec-4349-9d80-9ee356780baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebb7227-f885-4ecd-9750-d0fdf1890a38", "name": "network-vif-plugged", "status": "completed", "tag": "65bde22a-cc07-4cd6-a11a-68aa531ab57a"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:27:47.482719 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-1703f9c5-a962-499b-90a0-820d0d4fada0 req-4e41e3e8-cdec-4349-9d80-9ee356780baf service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:47.483783 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-1703f9c5-a962-499b-90a0-820d0d4fada0 req-4e41e3e8-cdec-4349-9d80-9ee356780baf service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:47.483783 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-1703f9c5-a962-499b-90a0-820d0d4fada0 req-4e41e3e8-cdec-4349-9d80-9ee356780baf service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:47.497247 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-1703f9c5-a962-499b-90a0-820d0d4fada0 req-4e41e3e8-cdec-4349-9d80-9ee356780baf service nova] Creating event network-vif-plugged:65bde22a-cc07-4cd6-a11a-68aa531ab57a for instance 8ebb7227-f885-4ecd-9750-d0fdf1890a38 on hv-cinder-85200 Aug 05 07:27:47.502496 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-1703f9c5-a962-499b-90a0-820d0d4fada0 req-4e41e3e8-cdec-4349-9d80-9ee356780baf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036360 Aug 05 07:27:47.503792 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 584/1154] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:27:47.961119 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8d401778-0c33-40a4-8620-eeeb137f8c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:47.961657 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8d401778-0c33-40a4-8620-eeeb137f8c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: 5b2739a6-db43-428a-9342-53229c6530fb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:47.968631 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d401778-0c33-40a4-8620-eeeb137f8c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:47.969135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d401778-0c33-40a4-8620-eeeb137f8c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:47.969560 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d401778-0c33-40a4-8620-eeeb137f8c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:47.970268 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d401778-0c33-40a4-8620-eeeb137f8c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:47.970681 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d401778-0c33-40a4-8620-eeeb137f8c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:47.971099 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d401778-0c33-40a4-8620-eeeb137f8c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:47.985135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-8d401778-0c33-40a4-8620-eeeb137f8c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] HTTP exception thrown: Instance 5b2739a6-db43-428a-9342-53229c6530fb could not be found. Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8d401778-0c33-40a4-8620-eeeb137f8c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Request method failure captured: Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb HTTP/1.1 Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MPjnss623grFw3OIsxvZyPD5d8DyUIJ9IvlHez0UG_G_JbTgoBftEKBd_N4FPQc5BXdwd3FB4TNCJbLP1EHNenLcBf1QKCl2wyv6M5a2nhx962v4gzpTEHdQ2X6Ig_NG89llIU4w4nIQO3MgNwg4AXUZuq3Wx8Qk0y83rDyfIdZhLg Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 2720b0660de14a19a05ef57efaa01cd8 Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:27:47.986874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:27:47.989457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2720b0660de14a19a05ef57efaa01cd8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:27:47.989457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:27:47.989457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 2720b0660de14a19a05ef57efaa01cd8 Aug 05 07:27:47.989457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:27:47.989457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-TestVolumeBootPattern-1137302503-project Aug 05 07:27:47.989457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:27:47.989457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:27:47.989457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 43ef613541cb4fd49faa3a3cec1a58c8 Aug 05 07:27:47.989457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-TestVolumeBootPattern-1137302503-project Aug 05 07:27:47.989457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:27:47.989457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance 5b2739a6-db43-428a-9342-53229c6530fb could not be found. Aug 05 07:27:47.989457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '5b2739a6-db43-428a-9342-53229c6530fb'} Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b2739a6-db43-428a-9342-53229c6530fb could not be found. Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:27:47.990550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b2739a6-db43-428a-9342-53229c6530fb could not be found. Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b2739a6-db43-428a-9342-53229c6530fb could not be found. Aug 05 07:27:47.992286 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:47.994122 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8d401778-0c33-40a4-8620-eeeb137f8c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Returning 404 to user: Instance 5b2739a6-db43-428a-9342-53229c6530fb could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:27:47.994122 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8d401778-0c33-40a4-8620-eeeb137f8c16 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb" status: 404 len: 111 microversion: 2.1 time: 0.031310 Aug 05 07:27:47.994122 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 571/1155] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:47 2022] GET /compute/v2.1/servers/5b2739a6-db43-428a-9342-53229c6530fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:27:48.141711 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-d356f702-4285-44f8-acd2-1188a56be99d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:48.142399 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-d356f702-4285-44f8-acd2-1188a56be99d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:48.148879 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d356f702-4285-44f8-acd2-1188a56be99d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:48.149415 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d356f702-4285-44f8-acd2-1188a56be99d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:48.149855 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d356f702-4285-44f8-acd2-1188a56be99d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:48.150539 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d356f702-4285-44f8-acd2-1188a56be99d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:48.150978 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d356f702-4285-44f8-acd2-1188a56be99d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:48.151388 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-d356f702-4285-44f8-acd2-1188a56be99d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:48.294319 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-d356f702-4285-44f8-acd2-1188a56be99d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:48.302091 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-d356f702-4285-44f8-acd2-1188a56be99d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1315 microversion: 2.1 time: 0.165224 Aug 05 07:27:48.302675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 585/1156] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:48 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:48.481922 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dd9b7b83-d7a5-4b8f-95d3-912ba50228d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:48.482410 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dd9b7b83-d7a5-4b8f-95d3-912ba50228d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:48.488915 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd9b7b83-d7a5-4b8f-95d3-912ba50228d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:48.489441 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd9b7b83-d7a5-4b8f-95d3-912ba50228d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:48.489871 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd9b7b83-d7a5-4b8f-95d3-912ba50228d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:48.490633 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd9b7b83-d7a5-4b8f-95d3-912ba50228d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:48.491090 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd9b7b83-d7a5-4b8f-95d3-912ba50228d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:48.491614 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dd9b7b83-d7a5-4b8f-95d3-912ba50228d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:48.506191 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-dd9b7b83-d7a5-4b8f-95d3-912ba50228d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] HTTP exception thrown: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dd9b7b83-d7a5-4b8f-95d3-912ba50228d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Request method failure captured: Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c HTTP/1.1 Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MPjnss623grFw3OIsxvZyPD5d8DyUIJ9IvlHez0UG_G_JbTgoBftEKBd_N4FPQc5BXdwd3FB4TNCJbLP1EHNenLcBf1QKCl2wyv6M5a2nhx962v4gzpTEHdQ2X6Ig_NG89llIU4w4nIQO3MgNwg4AXUZuq3Wx8Qk0y83rDyfIdZhLg Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 2720b0660de14a19a05ef57efaa01cd8 Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:27:48.508108 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:27:48.509647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2720b0660de14a19a05ef57efaa01cd8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:27:48.509647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:27:48.509647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 2720b0660de14a19a05ef57efaa01cd8 Aug 05 07:27:48.509647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:27:48.509647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-TestVolumeBootPattern-1137302503-project Aug 05 07:27:48.509647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:27:48.509647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:27:48.509647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 43ef613541cb4fd49faa3a3cec1a58c8 Aug 05 07:27:48.509647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-TestVolumeBootPattern-1137302503-project Aug 05 07:27:48.509647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:27:48.509647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:27:48.509647 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'b8f14ba1-bb82-4edf-baf2-308048c6c67c'} Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:27:48.510442 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:27:48.511956 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:48.513469 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dd9b7b83-d7a5-4b8f-95d3-912ba50228d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Returning 404 to user: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:27:48.513469 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-dd9b7b83-d7a5-4b8f-95d3-912ba50228d6 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 404 len: 111 microversion: 2.1 time: 0.031775 Aug 05 07:27:48.513469 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 572/1157] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:27:48 2022] DELETE /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:27:48.519442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3bffdd79-4bfa-4f4a-8046-37472faa7bd7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:48.520074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3bffdd79-4bfa-4f4a-8046-37472faa7bd7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] [instance: b8f14ba1-bb82-4edf-baf2-308048c6c67c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:48.526677 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3bffdd79-4bfa-4f4a-8046-37472faa7bd7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:48.527165 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3bffdd79-4bfa-4f4a-8046-37472faa7bd7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:48.527870 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3bffdd79-4bfa-4f4a-8046-37472faa7bd7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:48.528570 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3bffdd79-4bfa-4f4a-8046-37472faa7bd7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:48.529053 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3bffdd79-4bfa-4f4a-8046-37472faa7bd7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:48.529483 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3bffdd79-4bfa-4f4a-8046-37472faa7bd7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:48.543803 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-3bffdd79-4bfa-4f4a-8046-37472faa7bd7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] HTTP exception thrown: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3bffdd79-4bfa-4f4a-8046-37472faa7bd7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Request method failure captured: Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c HTTP/1.1 Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MPjnss623grFw3OIsxvZyPD5d8DyUIJ9IvlHez0UG_G_JbTgoBftEKBd_N4FPQc5BXdwd3FB4TNCJbLP1EHNenLcBf1QKCl2wyv6M5a2nhx962v4gzpTEHdQ2X6Ig_NG89llIU4w4nIQO3MgNwg4AXUZuq3Wx8Qk0y83rDyfIdZhLg Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 2720b0660de14a19a05ef57efaa01cd8 Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:27:48.545518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:27:48.547137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2720b0660de14a19a05ef57efaa01cd8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2720b0660de14a19a05ef57efaa01cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:27:48.547137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:27:48.547137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 2720b0660de14a19a05ef57efaa01cd8 Aug 05 07:27:48.547137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-TestVolumeBootPattern-1137302503 Aug 05 07:27:48.547137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-TestVolumeBootPattern-1137302503-project Aug 05 07:27:48.547137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:27:48.547137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:27:48.547137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 43ef613541cb4fd49faa3a3cec1a58c8 Aug 05 07:27:48.547137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-TestVolumeBootPattern-1137302503-project Aug 05 07:27:48.547137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:27:48.547137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:27:48.547137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'b8f14ba1-bb82-4edf-baf2-308048c6c67c'} Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:27:48.548042 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. Aug 05 07:27:48.549632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:48.551203 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3bffdd79-4bfa-4f4a-8046-37472faa7bd7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Returning 404 to user: Instance b8f14ba1-bb82-4edf-baf2-308048c6c67c could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:27:48.551203 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3bffdd79-4bfa-4f4a-8046-37472faa7bd7 tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c" status: 404 len: 111 microversion: 2.1 time: 0.031698 Aug 05 07:27:48.551203 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 586/1158] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:48 2022] GET /compute/v2.1/servers/b8f14ba1-bb82-4edf-baf2-308048c6c67c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:27:48.622008 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dda3e6db-aa18-4209-bcd5-494adbbb59f3 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:48.623005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dda3e6db-aa18-4209-bcd5-494adbbb59f3 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:48.628728 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dda3e6db-aa18-4209-bcd5-494adbbb59f3 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:48.629263 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dda3e6db-aa18-4209-bcd5-494adbbb59f3 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:48.629697 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dda3e6db-aa18-4209-bcd5-494adbbb59f3 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:48.630536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dda3e6db-aa18-4209-bcd5-494adbbb59f3 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:48.631855 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dda3e6db-aa18-4209-bcd5-494adbbb59f3 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:48.631855 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dda3e6db-aa18-4209-bcd5-494adbbb59f3 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:48.667237 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dda3e6db-aa18-4209-bcd5-494adbbb59f3 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:27:48.751387 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-dda3e6db-aa18-4209-bcd5-494adbbb59f3 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 204 len: 0 microversion: 2.1 time: 0.133562 Aug 05 07:27:48.751976 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 573/1159] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:27:48 2022] DELETE /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:27:48.761565 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-74f9fe5d-db71-413f-96b1-5bffe8008d28 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:48.762164 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-74f9fe5d-db71-413f-96b1-5bffe8008d28 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:48.768673 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-74f9fe5d-db71-413f-96b1-5bffe8008d28 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:48.769177 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-74f9fe5d-db71-413f-96b1-5bffe8008d28 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:48.769597 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-74f9fe5d-db71-413f-96b1-5bffe8008d28 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:48.770819 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-74f9fe5d-db71-413f-96b1-5bffe8008d28 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:48.771275 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-74f9fe5d-db71-413f-96b1-5bffe8008d28 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:48.771691 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-74f9fe5d-db71-413f-96b1-5bffe8008d28 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:48.918974 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-74f9fe5d-db71-413f-96b1-5bffe8008d28 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:48.929540 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-74f9fe5d-db71-413f-96b1-5bffe8008d28 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1513 microversion: 2.1 time: 0.171845 Aug 05 07:27:48.930217 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 587/1160] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:48 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:49.327918 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1e01c5b1-9ed8-4c8b-94a1-ddbb2ada482d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:49.328681 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1e01c5b1-9ed8-4c8b-94a1-ddbb2ada482d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:49.339262 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1e01c5b1-9ed8-4c8b-94a1-ddbb2ada482d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:49.339262 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1e01c5b1-9ed8-4c8b-94a1-ddbb2ada482d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:49.339552 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1e01c5b1-9ed8-4c8b-94a1-ddbb2ada482d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:49.340218 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1e01c5b1-9ed8-4c8b-94a1-ddbb2ada482d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:49.340884 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1e01c5b1-9ed8-4c8b-94a1-ddbb2ada482d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:49.341523 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1e01c5b1-9ed8-4c8b-94a1-ddbb2ada482d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:49.489524 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1e01c5b1-9ed8-4c8b-94a1-ddbb2ada482d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:49.500498 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1e01c5b1-9ed8-4c8b-94a1-ddbb2ada482d tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1315 microversion: 2.1 time: 0.179092 Aug 05 07:27:49.501412 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 574/1161] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:49 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:49.890953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-043eb673-10d1-40cf-bca7-17d72f7f698d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] Calling method '.version_select at 0x7f4963f199d0>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:49.918164 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-043eb673-10d1-40cf-bca7-17d72f7f698d tempest-TestVolumeBootPattern-1137302503 tempest-TestVolumeBootPattern-1137302503-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1981702890" status: 202 len: 0 microversion: 2.1 time: 0.031077 Aug 05 07:27:49.918754 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 588/1162] 10.222.0.27 () {58 vars in 1263 bytes} [Fri Aug 5 07:27:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1981702890 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:27:49.950763 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-075fe7b0-61c0-48eb-b136-3161275717d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:49.951367 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-075fe7b0-61c0-48eb-b136-3161275717d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:49.957905 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-075fe7b0-61c0-48eb-b136-3161275717d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:49.958627 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-075fe7b0-61c0-48eb-b136-3161275717d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:49.959037 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-075fe7b0-61c0-48eb-b136-3161275717d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:49.959945 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-075fe7b0-61c0-48eb-b136-3161275717d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:49.960482 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-075fe7b0-61c0-48eb-b136-3161275717d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:49.960923 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-075fe7b0-61c0-48eb-b136-3161275717d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:50.100791 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-075fe7b0-61c0-48eb-b136-3161275717d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:50.108615 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-075fe7b0-61c0-48eb-b136-3161275717d2 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1513 microversion: 2.1 time: 0.161710 Aug 05 07:27:50.109222 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 575/1163] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:49 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:50.525769 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a50233b7-dacb-4166-b035-f8200820a4b1 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:50.526401 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a50233b7-dacb-4166-b035-f8200820a4b1 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:50.532837 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a50233b7-dacb-4166-b035-f8200820a4b1 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:50.533407 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a50233b7-dacb-4166-b035-f8200820a4b1 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:50.533775 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a50233b7-dacb-4166-b035-f8200820a4b1 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:50.534458 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a50233b7-dacb-4166-b035-f8200820a4b1 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:50.534884 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a50233b7-dacb-4166-b035-f8200820a4b1 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:50.535293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a50233b7-dacb-4166-b035-f8200820a4b1 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:50.669431 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a50233b7-dacb-4166-b035-f8200820a4b1 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:50.677378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a50233b7-dacb-4166-b035-f8200820a4b1 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1465 microversion: 2.1 time: 0.155760 Aug 05 07:27:50.677927 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 589/1164] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:50 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:27:50.724110 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c2367155-0046-46bf-abe5-a4b507c1e1f5 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:50.724650 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c2367155-0046-46bf-abe5-a4b507c1e1f5 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:50.731499 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2367155-0046-46bf-abe5-a4b507c1e1f5 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:50.731984 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2367155-0046-46bf-abe5-a4b507c1e1f5 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:50.732390 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2367155-0046-46bf-abe5-a4b507c1e1f5 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:50.733125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2367155-0046-46bf-abe5-a4b507c1e1f5 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:50.733574 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2367155-0046-46bf-abe5-a4b507c1e1f5 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:50.733994 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2367155-0046-46bf-abe5-a4b507c1e1f5 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:50.760110 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c2367155-0046-46bf-abe5-a4b507c1e1f5 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:27:50.838669 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c2367155-0046-46bf-abe5-a4b507c1e1f5 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 204 len: 0 microversion: 2.1 time: 0.118169 Aug 05 07:27:50.839308 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 576/1165] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:27:50 2022] DELETE /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 07:27:50.848178 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-a4b82bbe-c2ef-406a-ae50-35d7703e4c3b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:50.848788 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-a4b82bbe-c2ef-406a-ae50-35d7703e4c3b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:50.855149 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a4b82bbe-c2ef-406a-ae50-35d7703e4c3b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:50.855621 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a4b82bbe-c2ef-406a-ae50-35d7703e4c3b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:50.856046 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a4b82bbe-c2ef-406a-ae50-35d7703e4c3b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:50.856762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a4b82bbe-c2ef-406a-ae50-35d7703e4c3b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:50.857235 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a4b82bbe-c2ef-406a-ae50-35d7703e4c3b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:50.857654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-a4b82bbe-c2ef-406a-ae50-35d7703e4c3b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:51.006228 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-a4b82bbe-c2ef-406a-ae50-35d7703e4c3b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:51.015618 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-a4b82bbe-c2ef-406a-ae50-35d7703e4c3b tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1471 microversion: 2.1 time: 0.171244 Aug 05 07:27:51.016519 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 590/1166] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:50 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:51.130924 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-76fce34d-e4cc-4d96-bf30-6196225b3c2f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:51.132360 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-76fce34d-e4cc-4d96-bf30-6196225b3c2f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:51.139328 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-76fce34d-e4cc-4d96-bf30-6196225b3c2f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:51.139804 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-76fce34d-e4cc-4d96-bf30-6196225b3c2f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:51.140236 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-76fce34d-e4cc-4d96-bf30-6196225b3c2f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:51.141461 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-76fce34d-e4cc-4d96-bf30-6196225b3c2f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:51.142169 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-76fce34d-e4cc-4d96-bf30-6196225b3c2f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:51.142340 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-76fce34d-e4cc-4d96-bf30-6196225b3c2f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:51.375181 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-76fce34d-e4cc-4d96-bf30-6196225b3c2f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:51.378278 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:51.388971 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-76fce34d-e4cc-4d96-bf30-6196225b3c2f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1513 microversion: 2.1 time: 0.262180 Aug 05 07:27:51.389837 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 577/1167] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:51 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1513 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:52.037056 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-adff0fed-afc0-4f36-8a59-dd451869f008 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:52.037940 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-adff0fed-afc0-4f36-8a59-dd451869f008 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:52.044614 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adff0fed-afc0-4f36-8a59-dd451869f008 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:52.045205 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adff0fed-afc0-4f36-8a59-dd451869f008 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:52.045714 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adff0fed-afc0-4f36-8a59-dd451869f008 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:52.046808 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adff0fed-afc0-4f36-8a59-dd451869f008 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:52.047938 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adff0fed-afc0-4f36-8a59-dd451869f008 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:52.048725 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adff0fed-afc0-4f36-8a59-dd451869f008 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:52.319841 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-adff0fed-afc0-4f36-8a59-dd451869f008 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:52.328103 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-adff0fed-afc0-4f36-8a59-dd451869f008 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1471 microversion: 2.1 time: 0.295014 Aug 05 07:27:52.328673 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 591/1168] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:52 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1471 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:52.414960 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b7671bb4-20ab-49ef-b0de-894494ab5a62 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:52.415992 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b7671bb4-20ab-49ef-b0de-894494ab5a62 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:52.435441 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b7671bb4-20ab-49ef-b0de-894494ab5a62 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:52.435950 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b7671bb4-20ab-49ef-b0de-894494ab5a62 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:52.436394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b7671bb4-20ab-49ef-b0de-894494ab5a62 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:52.437160 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b7671bb4-20ab-49ef-b0de-894494ab5a62 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:52.437610 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b7671bb4-20ab-49ef-b0de-894494ab5a62 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:52.438038 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b7671bb4-20ab-49ef-b0de-894494ab5a62 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:52.881314 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b7671bb4-20ab-49ef-b0de-894494ab5a62 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:52.890388 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b7671bb4-20ab-49ef-b0de-894494ab5a62 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1513 microversion: 2.1 time: 0.480011 Aug 05 07:27:52.900221 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 578/1169] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:52 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1513 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:53.357074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b12a30a1-0479-4da6-aad8-105946876b00 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:53.357745 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b12a30a1-0479-4da6-aad8-105946876b00 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:53.364563 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b12a30a1-0479-4da6-aad8-105946876b00 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:53.365087 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b12a30a1-0479-4da6-aad8-105946876b00 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:53.365523 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b12a30a1-0479-4da6-aad8-105946876b00 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:53.366240 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b12a30a1-0479-4da6-aad8-105946876b00 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:53.366683 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b12a30a1-0479-4da6-aad8-105946876b00 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:53.367114 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b12a30a1-0479-4da6-aad8-105946876b00 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:53.414439 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-415774b0-3601-4479-839f-b93b4b1bd144 req-64e31ff0-37da-4676-b887-b7e4ec985ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a908d4c-f340-4eac-b693-6b31a013f1a5", "name": "network-vif-deleted", "tag": "8acf667b-4d18-4af9-8032-92bbfd51af89"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:27:53.435501 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-415774b0-3601-4479-839f-b93b4b1bd144 req-64e31ff0-37da-4676-b887-b7e4ec985ff9 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:53.436170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-415774b0-3601-4479-839f-b93b4b1bd144 req-64e31ff0-37da-4676-b887-b7e4ec985ff9 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:53.436758 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-415774b0-3601-4479-839f-b93b4b1bd144 req-64e31ff0-37da-4676-b887-b7e4ec985ff9 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:53.481756 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-415774b0-3601-4479-839f-b93b4b1bd144 req-64e31ff0-37da-4676-b887-b7e4ec985ff9 service nova] Creating event network-vif-deleted:8acf667b-4d18-4af9-8032-92bbfd51af89 for instance 8a908d4c-f340-4eac-b693-6b31a013f1a5 on hv-cinder-85200 Aug 05 07:27:53.494170 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-415774b0-3601-4479-839f-b93b4b1bd144 req-64e31ff0-37da-4676-b887-b7e4ec985ff9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083109 Aug 05 07:27:53.495520 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 579/1170] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:27:53.552346 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-42e8c0b3-dde8-4543-b800-927b78f2ef3f req-da581668-8db8-417b-8d53-f4ad2c437597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebb7227-f885-4ecd-9750-d0fdf1890a38", "name": "network-vif-deleted", "tag": "65bde22a-cc07-4cd6-a11a-68aa531ab57a"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:27:53.556673 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b12a30a1-0479-4da6-aad8-105946876b00 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237c36ca81e34f87870b71d2e80cd37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:53.571704 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b12a30a1-0479-4da6-aad8-105946876b00 tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 200 len: 1429 microversion: 2.1 time: 0.225080 Aug 05 07:27:53.572836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 592/1171] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:53 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 1429 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:53.594068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-42e8c0b3-dde8-4543-b800-927b78f2ef3f req-da581668-8db8-417b-8d53-f4ad2c437597 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:53.594925 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-42e8c0b3-dde8-4543-b800-927b78f2ef3f req-da581668-8db8-417b-8d53-f4ad2c437597 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:53.595383 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-42e8c0b3-dde8-4543-b800-927b78f2ef3f req-da581668-8db8-417b-8d53-f4ad2c437597 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:53.618137 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-42e8c0b3-dde8-4543-b800-927b78f2ef3f req-da581668-8db8-417b-8d53-f4ad2c437597 service nova] Creating event network-vif-deleted:65bde22a-cc07-4cd6-a11a-68aa531ab57a for instance 8ebb7227-f885-4ecd-9750-d0fdf1890a38 on hv-cinder-85200 Aug 05 07:27:53.625058 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-42e8c0b3-dde8-4543-b800-927b78f2ef3f req-da581668-8db8-417b-8d53-f4ad2c437597 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081183 Aug 05 07:27:53.629915 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 580/1172] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:27:53.912063 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:53.912686 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:53.918894 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:53.919577 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:53.920193 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:53.920885 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:53.921355 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:53.921774 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:53.953058 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:53.953535 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:53.953965 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:53.954407 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lazy-loading 'fault' on Instance uuid 8a908d4c-f340-4eac-b693-6b31a013f1a5 {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:27:54.022728 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:27:54.046366 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-68e288ba-9bfe-46c5-bf07-f8dd52439db6 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 200 len: 1308 microversion: 2.1 time: 0.138377 Aug 05 07:27:54.049915 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 593/1173] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:53 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:27:54.598917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-15ac72e4-5af5-4f36-894c-6b1ac7f7787a tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:54.599587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-15ac72e4-5af5-4f36-894c-6b1ac7f7787a tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] [instance: 8ebb7227-f885-4ecd-9750-d0fdf1890a38] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:54.607455 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-15ac72e4-5af5-4f36-894c-6b1ac7f7787a tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:54.608758 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-15ac72e4-5af5-4f36-894c-6b1ac7f7787a tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:54.609248 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-15ac72e4-5af5-4f36-894c-6b1ac7f7787a tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:54.610298 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-15ac72e4-5af5-4f36-894c-6b1ac7f7787a tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:54.611053 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-15ac72e4-5af5-4f36-894c-6b1ac7f7787a tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:54.612386 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-15ac72e4-5af5-4f36-894c-6b1ac7f7787a tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:54.628150 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-15ac72e4-5af5-4f36-894c-6b1ac7f7787a tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] HTTP exception thrown: Instance 8ebb7227-f885-4ecd-9750-d0fdf1890a38 could not be found. Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-15ac72e4-5af5-4f36-894c-6b1ac7f7787a tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Request method failure captured: Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 HTTP/1.1 Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MZeMpm7fqopTjq5n47YjZWzEY-aEuVNLb_JD7WCYFR7h9cDDJ8kGLPR4Gf1tLvLHaEJyDeZDLPlQMG4Mgo2txzud3_niIEPBpD1x5hXETpBXu-YrkCPek9bgxk9sY8iEz-AIqKvFxideUX-KZjh7P0Di8nB0z086jLtPt7RPb5uLFM Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: d0d79fa7d5aa4f3ca24ea285ea9fe273 Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesNegativeTest-61470744 Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:27:54.629869 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:27:54.631903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0d79fa7d5aa4f3ca24ea285ea9fe273", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0d79fa7d5aa4f3ca24ea285ea9fe273"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0d79fa7d5aa4f3ca24ea285ea9fe273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0d79fa7d5aa4f3ca24ea285ea9fe273"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:27:54.631903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesNegativeTest-61470744 Aug 05 07:27:54.631903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: d0d79fa7d5aa4f3ca24ea285ea9fe273 Aug 05 07:27:54.631903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesNegativeTest-61470744 Aug 05 07:27:54.631903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesNegativeTest-61470744-project Aug 05 07:27:54.631903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:27:54.631903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:27:54.631903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: 237c36ca81e34f87870b71d2e80cd37d Aug 05 07:27:54.631903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesNegativeTest-61470744-project Aug 05 07:27:54.631903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:27:54.631903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance 8ebb7227-f885-4ecd-9750-d0fdf1890a38 could not be found. Aug 05 07:27:54.631903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '8ebb7227-f885-4ecd-9750-d0fdf1890a38'} Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebb7227-f885-4ecd-9750-d0fdf1890a38 could not be found. Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:27:54.632874 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebb7227-f885-4ecd-9750-d0fdf1890a38 could not be found. Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebb7227-f885-4ecd-9750-d0fdf1890a38 could not be found. Aug 05 07:27:54.634450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:27:54.635793 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-15ac72e4-5af5-4f36-894c-6b1ac7f7787a tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] Returning 404 to user: Instance 8ebb7227-f885-4ecd-9750-d0fdf1890a38 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:27:54.635793 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-15ac72e4-5af5-4f36-894c-6b1ac7f7787a tempest-VolumesNegativeTest-61470744 tempest-VolumesNegativeTest-61470744-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38" status: 404 len: 111 microversion: 2.1 time: 0.036665 Aug 05 07:27:54.635793 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 581/1174] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:54 2022] GET /compute/v2.1/servers/8ebb7227-f885-4ecd-9750-d0fdf1890a38 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:27:55.070178 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-adb53281-dc97-4806-a6ac-d78a871cd495 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:27:55.071521 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-adb53281-dc97-4806-a6ac-d78a871cd495 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: 8a908d4c-f340-4eac-b693-6b31a013f1a5] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:27:55.079833 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adb53281-dc97-4806-a6ac-d78a871cd495 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:55.080573 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adb53281-dc97-4806-a6ac-d78a871cd495 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:55.082324 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adb53281-dc97-4806-a6ac-d78a871cd495 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:55.082324 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adb53281-dc97-4806-a6ac-d78a871cd495 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:27:55.082675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adb53281-dc97-4806-a6ac-d78a871cd495 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:27:55.082852 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adb53281-dc97-4806-a6ac-d78a871cd495 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:27:55.098221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-adb53281-dc97-4806-a6ac-d78a871cd495 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] HTTP exception thrown: Instance 8a908d4c-f340-4eac-b693-6b31a013f1a5 could not be found. Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-adb53281-dc97-4806-a6ac-d78a871cd495 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Request method failure captured: Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 HTTP/1.1 Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MYOSgAHQ4kGVVXZKkZoRKE6saYqs6vR9HOojqIlAgkpehrt81Jw5f8xJaVCSgR4v-H91KNXrrwF2uw1OTra-9lnhcxl7QlZhZ5SFd1lKDZv-9v4CQL3zDHz3n2uK7CvIFnAkPoGxpE0An2s_DSWSEE9YukN85UEi5Kf6ijQGQKeMbY Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: f5b80306557f466c911aba552768c24e Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1154421679 Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:27:55.099785 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:27:55.101359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f5b80306557f466c911aba552768c24e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5b80306557f466c911aba552768c24e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5b80306557f466c911aba552768c24e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f5b80306557f466c911aba552768c24e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:27:55.101359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-VolumesSnapshotTestJSON-1154421679 Aug 05 07:27:55.101359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: f5b80306557f466c911aba552768c24e Aug 05 07:27:55.101359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1154421679 Aug 05 07:27:55.101359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-VolumesSnapshotTestJSON-1154421679-project Aug 05 07:27:55.101359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:27:55.101359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:27:55.101359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: a8662b6620724850b0bae866c518a100 Aug 05 07:27:55.101359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-VolumesSnapshotTestJSON-1154421679-project Aug 05 07:27:55.101359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:27:55.101359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance 8a908d4c-f340-4eac-b693-6b31a013f1a5 could not be found. Aug 05 07:27:55.101359 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': '8a908d4c-f340-4eac-b693-6b31a013f1a5'} Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a908d4c-f340-4eac-b693-6b31a013f1a5 could not be found. Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:27:55.102243 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a908d4c-f340-4eac-b693-6b31a013f1a5 could not be found. Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a908d4c-f340-4eac-b693-6b31a013f1a5 could not be found. Aug 05 07:27:55.103542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:27:55.113635 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-adb53281-dc97-4806-a6ac-d78a871cd495 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Returning 404 to user: Instance 8a908d4c-f340-4eac-b693-6b31a013f1a5 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:27:55.113635 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-adb53281-dc97-4806-a6ac-d78a871cd495 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5" status: 404 len: 111 microversion: 2.1 time: 0.035102 Aug 05 07:27:55.113635 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 594/1175] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:27:55 2022] GET /compute/v2.1/servers/8a908d4c-f340-4eac-b693-6b31a013f1a5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:28:06.563733 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:06.565470 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=13 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:06.679305 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1823782402", "imageRef": "e539c14d-6bb6-49e1-a233-44540f013954", "flavorRef": "452", "networks": [{"uuid": "948ebe5d-b030-4d83-b873-ebe4af1c28e3"}]}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:28:06.697019 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:06.698149 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=76 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:06.772651 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.network.neutron [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] validate_networks() for [('948ebe5d-b030-4d83-b873-ebe4af1c28e3', None, None, None, None, None)] {{(pid=117894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:28:06.839077 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d22d7798-b6c0-4d63-b842-7bcc18f9b072 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-906244347"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:28:06.839617 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d22d7798-b6c0-4d63-b842-7bcc18f9b072 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:06.847982 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d22d7798-b6c0-4d63-b842-7bcc18f9b072 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:06.848470 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d22d7798-b6c0-4d63-b842-7bcc18f9b072 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:06.848935 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d22d7798-b6c0-4d63-b842-7bcc18f9b072 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:06.849619 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d22d7798-b6c0-4d63-b842-7bcc18f9b072 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:06.850057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d22d7798-b6c0-4d63-b842-7bcc18f9b072 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:06.850476 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d22d7798-b6c0-4d63-b842-7bcc18f9b072 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:07.049078 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.network.security_group_api [None req-d22d7798-b6c0-4d63-b842-7bcc18f9b072 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Removing security group 9dd08194-5bc3-4587-a8c6-767b5363a7b5 from port 75147734-bff6-4247-ac9b-8d971477e25b Aug 05 07:28:07.438489 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d22d7798-b6c0-4d63-b842-7bcc18f9b072 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "POST /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/action" status: 202 len: 0 microversion: 2.1 time: 0.891569 Aug 05 07:28:07.452736 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 582/1176] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:28:06 2022] POST /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:28:07.454889 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Flavor limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:28:07.459463 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Image limits 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:28:07.463766 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Flavor pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:28:07.465863 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Image pref 0:0:0 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:28:07.468642 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.virt.hardware [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:28:07.474867 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-5385d981-f9a4-40fc-b245-71efe31b85f3 req-09c2ca69-a034-4ea2-b38b-6524d35c6d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f", "tag": "75147734-bff6-4247-ac9b-8d971477e25b"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:28:07.503157 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:07.505829 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:07.507122 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:07.509456 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:07.510253 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:07.510846 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:07.511175 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-5385d981-f9a4-40fc-b245-71efe31b85f3 req-09c2ca69-a034-4ea2-b38b-6524d35c6d07 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:07.511662 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-5385d981-f9a4-40fc-b245-71efe31b85f3 req-09c2ca69-a034-4ea2-b38b-6524d35c6d07 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:07.512086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-5385d981-f9a4-40fc-b245-71efe31b85f3 req-09c2ca69-a034-4ea2-b38b-6524d35c6d07 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:07.529604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-5385d981-f9a4-40fc-b245-71efe31b85f3 req-09c2ca69-a034-4ea2-b38b-6524d35c6d07 service nova] Creating event network-changed:75147734-bff6-4247-ac9b-8d971477e25b for instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f on hv-cinder-85200 Aug 05 07:28:07.541568 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-5385d981-f9a4-40fc-b245-71efe31b85f3 req-09c2ca69-a034-4ea2-b38b-6524d35c6d07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076481 Aug 05 07:28:07.541956 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Getting quotas for project f5b80306557f466c911aba552768c24e. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:28:07.544592 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 583/1177] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:28:07.547495 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Getting quotas for user a8662b6620724850b0bae866c518a100 and project f5b80306557f466c911aba552768c24e. Resources: {'ram', 'cores', 'instances'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:28:07.568264 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Going to run 1 instances... {{(pid=117894) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:28:07.572271 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e539c14d-6bb6-49e1-a233-44540f013954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:28:07.646481 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-de2c4e77-3403-4033-9d00-0556c631e02e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971736 Aug 05 07:28:07.648112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 595/1178] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:28:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 07:28:07.660760 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9e83df35-abe9-4686-b4b9-17cdba82e3fe tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:07.661638 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9e83df35-abe9-4686-b4b9-17cdba82e3fe tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:07.789784 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9e83df35-abe9-4686-b4b9-17cdba82e3fe tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:07.801197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9e83df35-abe9-4686-b4b9-17cdba82e3fe tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1219 microversion: 2.1 time: 0.144191 Aug 05 07:28:07.801826 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 584/1179] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:07 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:08.824721 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0a06a759-36f1-44e8-ad45-fe0bdb82f1dc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:08.826524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0a06a759-36f1-44e8-ad45-fe0bdb82f1dc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:08.849504 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0a06a759-36f1-44e8-ad45-fe0bdb82f1dc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:08.851877 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0a06a759-36f1-44e8-ad45-fe0bdb82f1dc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:08.855025 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0a06a759-36f1-44e8-ad45-fe0bdb82f1dc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:08.856261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0a06a759-36f1-44e8-ad45-fe0bdb82f1dc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:08.858032 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0a06a759-36f1-44e8-ad45-fe0bdb82f1dc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:08.860034 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0a06a759-36f1-44e8-ad45-fe0bdb82f1dc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:09.091007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-224d1b07-31d5-4260-b74d-dbdae3f4ec1e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:09.091653 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-224d1b07-31d5-4260-b74d-dbdae3f4ec1e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:09.105722 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-224d1b07-31d5-4260-b74d-dbdae3f4ec1e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:09.106204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-224d1b07-31d5-4260-b74d-dbdae3f4ec1e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:09.110373 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-224d1b07-31d5-4260-b74d-dbdae3f4ec1e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:09.111891 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-224d1b07-31d5-4260-b74d-dbdae3f4ec1e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:09.112947 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-224d1b07-31d5-4260-b74d-dbdae3f4ec1e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:09.113393 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-224d1b07-31d5-4260-b74d-dbdae3f4ec1e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:09.121424 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0a06a759-36f1-44e8-ad45-fe0bdb82f1dc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:09.134771 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0a06a759-36f1-44e8-ad45-fe0bdb82f1dc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1215 microversion: 2.1 time: 0.316123 Aug 05 07:28:09.135366 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 596/1180] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:08 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1215 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:09.159338 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-22e83199-72cd-4bad-b019-0806a26dacb6 req-052b0e8f-c182-4110-819a-21712dab7c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f", "tag": "75147734-bff6-4247-ac9b-8d971477e25b"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:28:09.194569 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-22e83199-72cd-4bad-b019-0806a26dacb6 req-052b0e8f-c182-4110-819a-21712dab7c90 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:09.195049 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-22e83199-72cd-4bad-b019-0806a26dacb6 req-052b0e8f-c182-4110-819a-21712dab7c90 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:09.195567 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-22e83199-72cd-4bad-b019-0806a26dacb6 req-052b0e8f-c182-4110-819a-21712dab7c90 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:09.227972 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-224d1b07-31d5-4260-b74d-dbdae3f4ec1e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lazy-loading 'services' on Instance uuid 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:28:09.241731 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-22e83199-72cd-4bad-b019-0806a26dacb6 req-052b0e8f-c182-4110-819a-21712dab7c90 service nova] Creating event network-changed:75147734-bff6-4247-ac9b-8d971477e25b for instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f on hv-cinder-85200 Aug 05 07:28:09.258524 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-22e83199-72cd-4bad-b019-0806a26dacb6 req-052b0e8f-c182-4110-819a-21712dab7c90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107781 Aug 05 07:28:09.259148 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 597/1181] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:28:09.358790 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-224d1b07-31d5-4260-b74d-dbdae3f4ec1e tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments/53ffbcc8-57fa-456e-a6da-f69f13d5e44d" status: 202 len: 0 microversion: 2.1 time: 0.271114 Aug 05 07:28:09.364588 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 585/1182] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 5 07:28:09 2022] DELETE /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments/53ffbcc8-57fa-456e-a6da-f69f13d5e44d => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:28:09.371191 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7f04bee0-aa90-47e1-97a1-ab7b8d580ae9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:09.374165 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7f04bee0-aa90-47e1-97a1-ab7b8d580ae9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:09.392887 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f04bee0-aa90-47e1-97a1-ab7b8d580ae9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:09.393799 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f04bee0-aa90-47e1-97a1-ab7b8d580ae9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:09.394410 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f04bee0-aa90-47e1-97a1-ab7b8d580ae9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:09.395599 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f04bee0-aa90-47e1-97a1-ab7b8d580ae9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:09.396227 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f04bee0-aa90-47e1-97a1-ab7b8d580ae9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:09.396804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7f04bee0-aa90-47e1-97a1-ab7b8d580ae9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:09.438459 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7f04bee0-aa90-47e1-97a1-ab7b8d580ae9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072042 Aug 05 07:28:09.440029 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 598/1183] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:28:09 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:28:10.158471 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a3543a87-3e72-49e3-b53c-df7e4bfd275f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:10.159181 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a3543a87-3e72-49e3-b53c-df7e4bfd275f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:10.178425 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3543a87-3e72-49e3-b53c-df7e4bfd275f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:10.179329 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3543a87-3e72-49e3-b53c-df7e4bfd275f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:10.179992 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3543a87-3e72-49e3-b53c-df7e4bfd275f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:10.180711 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3543a87-3e72-49e3-b53c-df7e4bfd275f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:10.181193 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3543a87-3e72-49e3-b53c-df7e4bfd275f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:10.181611 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3543a87-3e72-49e3-b53c-df7e4bfd275f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:10.454438 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-96e8cd4b-3d50-4431-a9f8-c10c8beb3b22 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:10.456680 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-96e8cd4b-3d50-4431-a9f8-c10c8beb3b22 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:10.474443 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96e8cd4b-3d50-4431-a9f8-c10c8beb3b22 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:10.474937 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96e8cd4b-3d50-4431-a9f8-c10c8beb3b22 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:10.475481 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96e8cd4b-3d50-4431-a9f8-c10c8beb3b22 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:10.476268 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96e8cd4b-3d50-4431-a9f8-c10c8beb3b22 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:10.477117 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96e8cd4b-3d50-4431-a9f8-c10c8beb3b22 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:10.477762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-96e8cd4b-3d50-4431-a9f8-c10c8beb3b22 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:10.576736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-96e8cd4b-3d50-4431-a9f8-c10c8beb3b22 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126566 Aug 05 07:28:10.579072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 599/1184] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:28:10 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:28:10.708577 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a3543a87-3e72-49e3-b53c-df7e4bfd275f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:10.723828 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a3543a87-3e72-49e3-b53c-df7e4bfd275f tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1289 microversion: 2.1 time: 0.570856 Aug 05 07:28:10.724852 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 586/1185] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:10 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1289 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:11.590897 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-ad3b1c12-7812-4934-b150-283a55baf270 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:11.593463 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-ad3b1c12-7812-4934-b150-283a55baf270 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:11.613914 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad3b1c12-7812-4934-b150-283a55baf270 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:11.614406 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad3b1c12-7812-4934-b150-283a55baf270 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:11.614833 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad3b1c12-7812-4934-b150-283a55baf270 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:11.615563 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad3b1c12-7812-4934-b150-283a55baf270 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:11.615999 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad3b1c12-7812-4934-b150-283a55baf270 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:11.620570 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-ad3b1c12-7812-4934-b150-283a55baf270 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:11.683733 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-ad3b1c12-7812-4934-b150-283a55baf270 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097719 Aug 05 07:28:11.684327 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 600/1186] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Aug 5 07:28:11 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 07:28:11.695543 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-302fd333-8c21-4093-91fe-69df6100ef56 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:11.696134 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-302fd333-8c21-4093-91fe-69df6100ef56 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:11.722789 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-302fd333-8c21-4093-91fe-69df6100ef56 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:11.723292 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-302fd333-8c21-4093-91fe-69df6100ef56 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:11.726580 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-302fd333-8c21-4093-91fe-69df6100ef56 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:11.727706 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-302fd333-8c21-4093-91fe-69df6100ef56 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:11.728348 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-302fd333-8c21-4093-91fe-69df6100ef56 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:11.731637 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-302fd333-8c21-4093-91fe-69df6100ef56 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:11.746768 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-adf8a592-f5bd-4f88-9685-546890f1e2e5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:11.747374 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-adf8a592-f5bd-4f88-9685-546890f1e2e5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:11.768217 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adf8a592-f5bd-4f88-9685-546890f1e2e5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:11.768721 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adf8a592-f5bd-4f88-9685-546890f1e2e5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:11.769177 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adf8a592-f5bd-4f88-9685-546890f1e2e5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:11.771648 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adf8a592-f5bd-4f88-9685-546890f1e2e5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:11.775171 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adf8a592-f5bd-4f88-9685-546890f1e2e5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:11.775922 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adf8a592-f5bd-4f88-9685-546890f1e2e5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:11.940489 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-302fd333-8c21-4093-91fe-69df6100ef56 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] HTTP exception thrown: Instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f is not attached to volume 53ffbcc8-57fa-456e-a6da-f69f13d5e44d Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-302fd333-8c21-4093-91fe-69df6100ef56 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Request method failure captured: Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments/53ffbcc8-57fa-456e-a6da-f69f13d5e44d HTTP/1.1 Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MVK4H9XmOO_n0Y8HXJ32id5XOA3FkQBQivMdAnmcOAQkNzlw8avcnUgQHbfcHSYtr188VyXT5KvC8AVpjuNqTKy4niHWDQCNxKrWO378au2JxCWfMDRFpVzB6SbDP3DWqfvieQ6Hldw0mJp93cHt9ap43d8POMQ5h8JXI7ZEJkpJcg Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 1d6a92e28cc44d6b9abe831fb219eea0 Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-TestMinimumBasicScenario-142941143 Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:28:11.961989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:28:11.963910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1d6a92e28cc44d6b9abe831fb219eea0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1d6a92e28cc44d6b9abe831fb219eea0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1d6a92e28cc44d6b9abe831fb219eea0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1d6a92e28cc44d6b9abe831fb219eea0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:28:11.963910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-TestMinimumBasicScenario-142941143 Aug 05 07:28:11.963910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 1d6a92e28cc44d6b9abe831fb219eea0 Aug 05 07:28:11.963910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-TestMinimumBasicScenario-142941143 Aug 05 07:28:11.963910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-TestMinimumBasicScenario-142941143-project Aug 05 07:28:11.963910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:28:11.963910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:28:11.963910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: e383fda8f4ce4ddc841552c751f1a7bf Aug 05 07:28:11.963910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-TestMinimumBasicScenario-142941143-project Aug 05 07:28:11.963910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:28:11.963910 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f is not attached to volume 53ffbcc8-57fa-456e-a6da-f69f13d5e44d Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'server_id': '0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f', 'id': '53ffbcc8-57fa-456e-a6da-f69f13d5e44d'} Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 53ffbcc8-57fa-456e-a6da-f69f13d5e44d. Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:28:11.964741 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f is not attached to volume 53ffbcc8-57fa-456e-a6da-f69f13d5e44d Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f is not attached to volume 53ffbcc8-57fa-456e-a6da-f69f13d5e44d Aug 05 07:28:11.967608 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:28:11.972674 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-302fd333-8c21-4093-91fe-69df6100ef56 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Returning 404 to user: Instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f is not attached to volume 53ffbcc8-57fa-456e-a6da-f69f13d5e44d {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:28:11.976445 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-302fd333-8c21-4093-91fe-69df6100ef56 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments/53ffbcc8-57fa-456e-a6da-f69f13d5e44d" status: 404 len: 154 microversion: 2.1 time: 0.285180 Aug 05 07:28:11.982369 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 587/1187] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 5 07:28:11 2022] DELETE /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f/os-volume_attachments/53ffbcc8-57fa-456e-a6da-f69f13d5e44d => generated 154 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:28:12.402865 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-adf8a592-f5bd-4f88-9685-546890f1e2e5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:12.419547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-adf8a592-f5bd-4f88-9685-546890f1e2e5 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1319 microversion: 2.1 time: 0.678357 Aug 05 07:28:12.421065 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 601/1188] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:11 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1319 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:28:12.980128 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-41c58661-3160-49de-8eab-4309b4226c50 req-beea8862-1b7a-4901-8d4d-d23589f32092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec21dc7-55fb-4e5a-9f05-01466119ed1c", "tag": "439ecc81-487f-469f-b6b9-0ed1dcea25d7"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:28:12.995023 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-41c58661-3160-49de-8eab-4309b4226c50 req-beea8862-1b7a-4901-8d4d-d23589f32092 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:12.995655 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-41c58661-3160-49de-8eab-4309b4226c50 req-beea8862-1b7a-4901-8d4d-d23589f32092 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:12.996144 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-41c58661-3160-49de-8eab-4309b4226c50 req-beea8862-1b7a-4901-8d4d-d23589f32092 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:13.008190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-41c58661-3160-49de-8eab-4309b4226c50 req-beea8862-1b7a-4901-8d4d-d23589f32092 service nova] Creating event network-changed:439ecc81-487f-469f-b6b9-0ed1dcea25d7 for instance dec21dc7-55fb-4e5a-9f05-01466119ed1c on hv-cinder-85200 Aug 05 07:28:13.014186 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-41c58661-3160-49de-8eab-4309b4226c50 req-beea8862-1b7a-4901-8d4d-d23589f32092 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039309 Aug 05 07:28:13.014651 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 588/1189] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:28:13.189907 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0fd3cec6-20f6-4cb4-9c80-f6fddc6f17d9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:13.190540 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0fd3cec6-20f6-4cb4-9c80-f6fddc6f17d9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:13.196828 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0fd3cec6-20f6-4cb4-9c80-f6fddc6f17d9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:13.197368 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0fd3cec6-20f6-4cb4-9c80-f6fddc6f17d9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:13.197762 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0fd3cec6-20f6-4cb4-9c80-f6fddc6f17d9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:13.198490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0fd3cec6-20f6-4cb4-9c80-f6fddc6f17d9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:13.198932 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0fd3cec6-20f6-4cb4-9c80-f6fddc6f17d9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:13.199312 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0fd3cec6-20f6-4cb4-9c80-f6fddc6f17d9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:13.227542 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0fd3cec6-20f6-4cb4-9c80-f6fddc6f17d9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Going to try to terminate instance {{(pid=117894) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:28:13.331786 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0fd3cec6-20f6-4cb4-9c80-f6fddc6f17d9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 204 len: 0 microversion: 2.1 time: 0.146253 Aug 05 07:28:13.332440 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 602/1190] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:28:13 2022] DELETE /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:28:13.346034 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5ef9470d-494a-4889-88cc-1fe798062295 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:13.346768 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5ef9470d-494a-4889-88cc-1fe798062295 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:13.353852 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5ef9470d-494a-4889-88cc-1fe798062295 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:13.354470 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5ef9470d-494a-4889-88cc-1fe798062295 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:13.354900 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5ef9470d-494a-4889-88cc-1fe798062295 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:13.355793 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5ef9470d-494a-4889-88cc-1fe798062295 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:13.356323 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5ef9470d-494a-4889-88cc-1fe798062295 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:13.356630 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5ef9470d-494a-4889-88cc-1fe798062295 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:13.447514 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-75623bec-4a09-4048-bcb7-701f6e2e9d66 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:13.448598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-75623bec-4a09-4048-bcb7-701f6e2e9d66 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:13.455968 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-75623bec-4a09-4048-bcb7-701f6e2e9d66 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:13.457486 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-75623bec-4a09-4048-bcb7-701f6e2e9d66 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:13.457929 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-75623bec-4a09-4048-bcb7-701f6e2e9d66 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:13.458636 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-75623bec-4a09-4048-bcb7-701f6e2e9d66 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:13.459274 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-75623bec-4a09-4048-bcb7-701f6e2e9d66 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:13.459874 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-75623bec-4a09-4048-bcb7-701f6e2e9d66 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:13.532035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5ef9470d-494a-4889-88cc-1fe798062295 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:13.541149 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5ef9470d-494a-4889-88cc-1fe798062295 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1553 microversion: 2.1 time: 0.199311 Aug 05 07:28:13.542593 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 589/1191] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:13 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:13.737116 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-75623bec-4a09-4048-bcb7-701f6e2e9d66 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:13.747716 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-75623bec-4a09-4048-bcb7-701f6e2e9d66 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1319 microversion: 2.1 time: 0.305401 Aug 05 07:28:13.748434 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 603/1192] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:13 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:14.569266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c979d4c5-1de3-4e9e-8fca-0620753db1ab tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:14.570724 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c979d4c5-1de3-4e9e-8fca-0620753db1ab tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:14.582653 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c979d4c5-1de3-4e9e-8fca-0620753db1ab tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:14.583133 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c979d4c5-1de3-4e9e-8fca-0620753db1ab tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:14.583561 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c979d4c5-1de3-4e9e-8fca-0620753db1ab tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:14.584302 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c979d4c5-1de3-4e9e-8fca-0620753db1ab tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:14.584753 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c979d4c5-1de3-4e9e-8fca-0620753db1ab tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:14.585206 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c979d4c5-1de3-4e9e-8fca-0620753db1ab tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:14.737344 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b1073b50-0ac2-4f91-81c0-ae3da6eeb707 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Action: 'create', calling method: .version_select at 0x7f4963f9c550>, body: {"keypair": {"name": "tempest-TestShelveInstance-598412302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5AyUay0JBm7E0nooke6tujdGajwLqE1h52DKtxyuqKSHl2s15TrbV+NrM7LH3KbCizbsu3Xodtvbw2kc2JnLNbTX21mmTLUUda04e/gycPybQqeBFGOeEa9mDlHWJZRA=="}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:28:14.737870 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c979d4c5-1de3-4e9e-8fca-0620753db1ab tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:14.746564 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c979d4c5-1de3-4e9e-8fca-0620753db1ab tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1553 microversion: 2.1 time: 0.187399 Aug 05 07:28:14.747146 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 590/1193] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:14 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:14.764322 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-b1073b50-0ac2-4f91-81c0-ae3da6eeb707 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Getting quotas for project 3cb5b787fed94e7091a4ff793951d8f0. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:28:14.769283 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.quota [None req-b1073b50-0ac2-4f91-81c0-ae3da6eeb707 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Getting quotas for user 4fbc21934e84415e93f29aa5073716f7 and project 3cb5b787fed94e7091a4ff793951d8f0. Resources: {'key_pairs'} {{(pid=117894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:28:14.772064 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-82064c2f-e67b-4378-8a74-dae90d8ea171 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:14.772698 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-82064c2f-e67b-4378-8a74-dae90d8ea171 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:14.779670 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-82064c2f-e67b-4378-8a74-dae90d8ea171 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:14.780304 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-82064c2f-e67b-4378-8a74-dae90d8ea171 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:14.780872 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-82064c2f-e67b-4378-8a74-dae90d8ea171 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:14.781908 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-82064c2f-e67b-4378-8a74-dae90d8ea171 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:14.782587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-82064c2f-e67b-4378-8a74-dae90d8ea171 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:14.783209 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-82064c2f-e67b-4378-8a74-dae90d8ea171 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:14.796440 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b1073b50-0ac2-4f91-81c0-ae3da6eeb707 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.208282 Aug 05 07:28:14.797758 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 604/1194] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Aug 5 07:28:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:28:15.008884 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-82064c2f-e67b-4378-8a74-dae90d8ea171 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:15.019111 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-82064c2f-e67b-4378-8a74-dae90d8ea171 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1319 microversion: 2.1 time: 0.253079 Aug 05 07:28:15.019728 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 591/1195] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:14 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:15.768385 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-67a96041-8564-4a36-be3d-bc84530f47a3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:15.769054 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-67a96041-8564-4a36-be3d-bc84530f47a3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:15.782473 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-67a96041-8564-4a36-be3d-bc84530f47a3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:15.782965 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-67a96041-8564-4a36-be3d-bc84530f47a3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:15.783459 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-67a96041-8564-4a36-be3d-bc84530f47a3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:15.785046 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-67a96041-8564-4a36-be3d-bc84530f47a3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:15.786043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-67a96041-8564-4a36-be3d-bc84530f47a3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:15.786629 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-67a96041-8564-4a36-be3d-bc84530f47a3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:15.956066 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-67a96041-8564-4a36-be3d-bc84530f47a3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:15.967436 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-67a96041-8564-4a36-be3d-bc84530f47a3 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1553 microversion: 2.1 time: 0.203432 Aug 05 07:28:15.975349 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 605/1196] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:15 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:16.040116 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6bef4d9d-8b62-4aa4-af97-9604ed737b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:16.040822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6bef4d9d-8b62-4aa4-af97-9604ed737b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:16.051201 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6bef4d9d-8b62-4aa4-af97-9604ed737b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:16.051655 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6bef4d9d-8b62-4aa4-af97-9604ed737b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:16.052092 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6bef4d9d-8b62-4aa4-af97-9604ed737b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:16.052836 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6bef4d9d-8b62-4aa4-af97-9604ed737b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:16.056201 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6bef4d9d-8b62-4aa4-af97-9604ed737b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:16.057761 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6bef4d9d-8b62-4aa4-af97-9604ed737b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:16.215136 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6bef4d9d-8b62-4aa4-af97-9604ed737b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:16.225664 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6bef4d9d-8b62-4aa4-af97-9604ed737b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1319 microversion: 2.1 time: 0.189462 Aug 05 07:28:16.226295 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 592/1197] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:16 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:16.989761 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-57cc7880-dc7f-4f09-94d8-4918baf1f940 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:16.991204 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-57cc7880-dc7f-4f09-94d8-4918baf1f940 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:16.998728 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-57cc7880-dc7f-4f09-94d8-4918baf1f940 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:16.999084 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-57cc7880-dc7f-4f09-94d8-4918baf1f940 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:16.999518 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-57cc7880-dc7f-4f09-94d8-4918baf1f940 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:17.000223 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-57cc7880-dc7f-4f09-94d8-4918baf1f940 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:17.000704 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-57cc7880-dc7f-4f09-94d8-4918baf1f940 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:17.001159 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-57cc7880-dc7f-4f09-94d8-4918baf1f940 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:17.160167 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-57cc7880-dc7f-4f09-94d8-4918baf1f940 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:17.168822 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-57cc7880-dc7f-4f09-94d8-4918baf1f940 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1553 microversion: 2.1 time: 0.183579 Aug 05 07:28:17.169440 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 606/1198] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:16 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:17.246428 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9885c955-e456-4dba-b3ca-c1e99ccf5b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:17.247687 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9885c955-e456-4dba-b3ca-c1e99ccf5b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:17.254511 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9885c955-e456-4dba-b3ca-c1e99ccf5b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:17.255002 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9885c955-e456-4dba-b3ca-c1e99ccf5b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:17.255414 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9885c955-e456-4dba-b3ca-c1e99ccf5b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:17.256457 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9885c955-e456-4dba-b3ca-c1e99ccf5b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:17.256917 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9885c955-e456-4dba-b3ca-c1e99ccf5b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:17.257337 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9885c955-e456-4dba-b3ca-c1e99ccf5b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:17.415432 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9885c955-e456-4dba-b3ca-c1e99ccf5b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:17.423017 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9885c955-e456-4dba-b3ca-c1e99ccf5b99 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1319 microversion: 2.1 time: 0.180726 Aug 05 07:28:17.423583 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 593/1199] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:17 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:18.114673 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-8d3c9e78-eb41-4171-a79a-cdb5eae1e62a req-a0289a18-44c8-483f-8595-58004a75b85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f", "name": "network-vif-deleted", "tag": "75147734-bff6-4247-ac9b-8d971477e25b"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:28:18.122250 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:18.126836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-8d3c9e78-eb41-4171-a79a-cdb5eae1e62a req-a0289a18-44c8-483f-8595-58004a75b85e service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:18.127548 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-8d3c9e78-eb41-4171-a79a-cdb5eae1e62a req-a0289a18-44c8-483f-8595-58004a75b85e service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:18.128126 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-8d3c9e78-eb41-4171-a79a-cdb5eae1e62a req-a0289a18-44c8-483f-8595-58004a75b85e service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:18.140877 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-8d3c9e78-eb41-4171-a79a-cdb5eae1e62a req-a0289a18-44c8-483f-8595-58004a75b85e service nova] Creating event network-vif-deleted:75147734-bff6-4247-ac9b-8d971477e25b for instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f on hv-cinder-85200 Aug 05 07:28:18.146552 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-8d3c9e78-eb41-4171-a79a-cdb5eae1e62a req-a0289a18-44c8-483f-8595-58004a75b85e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035445 Aug 05 07:28:18.151016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 607/1200] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:28:18.190109 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-18789f35-666d-4147-8e7c-fdb9297f9ab9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:18.190785 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-18789f35-666d-4147-8e7c-fdb9297f9ab9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:18.196957 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:18.199257 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18789f35-666d-4147-8e7c-fdb9297f9ab9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:18.199787 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18789f35-666d-4147-8e7c-fdb9297f9ab9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:18.200250 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18789f35-666d-4147-8e7c-fdb9297f9ab9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:18.201078 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18789f35-666d-4147-8e7c-fdb9297f9ab9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:18.201536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18789f35-666d-4147-8e7c-fdb9297f9ab9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:18.201955 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18789f35-666d-4147-8e7c-fdb9297f9ab9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:18.279774 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-18789f35-666d-4147-8e7c-fdb9297f9ab9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e383fda8f4ce4ddc841552c751f1a7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a92e28cc44d6b9abe831fb219eea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:18.291597 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-18789f35-666d-4147-8e7c-fdb9297f9ab9 tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 200 len: 1342 microversion: 2.1 time: 0.105004 Aug 05 07:28:18.292193 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 594/1201] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:18 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 1342 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:18.444808 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-f72b3bdc-383b-4ffb-8d44-4505bb4ec75e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:18.445595 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-f72b3bdc-383b-4ffb-8d44-4505bb4ec75e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:18.452378 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f72b3bdc-383b-4ffb-8d44-4505bb4ec75e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:18.452866 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f72b3bdc-383b-4ffb-8d44-4505bb4ec75e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:18.453330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f72b3bdc-383b-4ffb-8d44-4505bb4ec75e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:18.454027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f72b3bdc-383b-4ffb-8d44-4505bb4ec75e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:18.454478 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f72b3bdc-383b-4ffb-8d44-4505bb4ec75e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:18.454897 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-f72b3bdc-383b-4ffb-8d44-4505bb4ec75e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:18.628553 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-f72b3bdc-383b-4ffb-8d44-4505bb4ec75e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:18.637461 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-f72b3bdc-383b-4ffb-8d44-4505bb4ec75e tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1319 microversion: 2.1 time: 0.196853 Aug 05 07:28:18.638151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 608/1202] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:18 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:19.313058 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4dc1ea15-2700-4827-a319-43f76f45526b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:19.313688 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4dc1ea15-2700-4827-a319-43f76f45526b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] [instance: 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:19.320135 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4dc1ea15-2700-4827-a319-43f76f45526b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:19.320617 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4dc1ea15-2700-4827-a319-43f76f45526b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:19.321093 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4dc1ea15-2700-4827-a319-43f76f45526b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:19.321792 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4dc1ea15-2700-4827-a319-43f76f45526b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:19.322250 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4dc1ea15-2700-4827-a319-43f76f45526b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:19.322689 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4dc1ea15-2700-4827-a319-43f76f45526b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:19.340249 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-4dc1ea15-2700-4827-a319-43f76f45526b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] HTTP exception thrown: Instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f could not be found. Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4dc1ea15-2700-4827-a319-43f76f45526b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Request method failure captured: Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f HTTP/1.1 Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept: application/json Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Connection: close Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.11 Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABi7MVK4H9XmOO_n0Y8HXJ32id5XOA3FkQBQivMdAnmcOAQkNzlw8avcnUgQHbfcHSYtr188VyXT5KvC8AVpjuNqTKy4niHWDQCNxKrWO378au2JxCWfMDRFpVzB6SbDP3DWqfvieQ6Hldw0mJp93cHt9ap43d8POMQ5h8JXI7ZEJkpJcg Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 1d6a92e28cc44d6b9abe831fb219eea0 Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-TestMinimumBasicScenario-142941143 Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Role: member,reader Aug 05 07:28:19.341962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Roles: member,reader Aug 05 07:28:19.343710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1d6a92e28cc44d6b9abe831fb219eea0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1d6a92e28cc44d6b9abe831fb219eea0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1d6a92e28cc44d6b9abe831fb219eea0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1d6a92e28cc44d6b9abe831fb219eea0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:28:19.343710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-TestMinimumBasicScenario-142941143 Aug 05 07:28:19.343710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 1d6a92e28cc44d6b9abe831fb219eea0 Aug 05 07:28:19.343710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-TestMinimumBasicScenario-142941143 Aug 05 07:28:19.343710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User: tempest-TestMinimumBasicScenario-142941143-project Aug 05 07:28:19.343710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Aug 05 07:28:19.343710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Aug 05 07:28:19.343710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Id: e383fda8f4ce4ddc841552c751f1a7bf Aug 05 07:28:19.343710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-TestMinimumBasicScenario-142941143-project Aug 05 07:28:19.343710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: method: > Aug 05 07:28:19.343710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: exception: Instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f could not be found. Aug 05 07:28:19.343710 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f'} Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f could not be found. Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:28:19.344929 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f could not be found. Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f could not be found. Aug 05 07:28:19.346622 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Aug 05 07:28:19.348204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4dc1ea15-2700-4827-a319-43f76f45526b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Returning 404 to user: Instance 0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:28:19.348204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4dc1ea15-2700-4827-a319-43f76f45526b tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f" status: 404 len: 111 microversion: 2.1 time: 0.035039 Aug 05 07:28:19.348204 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 595/1203] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:19 2022] GET /compute/v2.1/servers/0acf1bd4-acb9-4fe8-9e1a-8f9a9cd2534f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:28:19.352653 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-50e443cf-cfee-45d4-83af-3b00e6b54d5c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] Calling method '.version_select at 0x7f49702d0790>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:19.376724 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-50e443cf-cfee-45d4-83af-3b00e6b54d5c tempest-TestMinimumBasicScenario-142941143 tempest-TestMinimumBasicScenario-142941143-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-518268991" status: 202 len: 0 microversion: 2.1 time: 0.028072 Aug 05 07:28:19.377362 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 609/1204] 10.222.0.27 () {58 vars in 1269 bytes} [Fri Aug 5 07:28:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-518268991 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:28:19.659618 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-279c632c-6c4b-456f-a201-c447e16243f7 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:19.660222 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-279c632c-6c4b-456f-a201-c447e16243f7 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:19.667301 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-279c632c-6c4b-456f-a201-c447e16243f7 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:19.672880 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-279c632c-6c4b-456f-a201-c447e16243f7 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:19.673496 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-279c632c-6c4b-456f-a201-c447e16243f7 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:19.674248 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-279c632c-6c4b-456f-a201-c447e16243f7 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:19.674744 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-279c632c-6c4b-456f-a201-c447e16243f7 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:19.675167 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-279c632c-6c4b-456f-a201-c447e16243f7 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:19.836530 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-279c632c-6c4b-456f-a201-c447e16243f7 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:19.845313 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-279c632c-6c4b-456f-a201-c447e16243f7 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1319 microversion: 2.1 time: 0.189485 Aug 05 07:28:19.845898 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 596/1205] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:19 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:20.264337 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-87c5fb2c-abb0-4415-9d77-bbec018cd777 req-d48440ea-73e2-459c-9bd3-f7892fa103c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec21dc7-55fb-4e5a-9f05-01466119ed1c", "name": "network-vif-plugged", "status": "completed", "tag": "439ecc81-487f-469f-b6b9-0ed1dcea25d7"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:28:20.276207 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-87c5fb2c-abb0-4415-9d77-bbec018cd777 req-d48440ea-73e2-459c-9bd3-f7892fa103c0 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:20.277229 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-87c5fb2c-abb0-4415-9d77-bbec018cd777 req-d48440ea-73e2-459c-9bd3-f7892fa103c0 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:20.278023 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-87c5fb2c-abb0-4415-9d77-bbec018cd777 req-d48440ea-73e2-459c-9bd3-f7892fa103c0 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:20.290653 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-87c5fb2c-abb0-4415-9d77-bbec018cd777 req-d48440ea-73e2-459c-9bd3-f7892fa103c0 service nova] Creating event network-vif-plugged:439ecc81-487f-469f-b6b9-0ed1dcea25d7 for instance dec21dc7-55fb-4e5a-9f05-01466119ed1c on hv-cinder-85200 Aug 05 07:28:20.296293 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-87c5fb2c-abb0-4415-9d77-bbec018cd777 req-d48440ea-73e2-459c-9bd3-f7892fa103c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035800 Aug 05 07:28:20.297655 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 610/1206] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:28:20.868221 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-18fc7057-3e92-4f61-960a-eb9ac01a0554 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:20.868846 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-18fc7057-3e92-4f61-960a-eb9ac01a0554 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:20.880044 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18fc7057-3e92-4f61-960a-eb9ac01a0554 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:20.880541 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18fc7057-3e92-4f61-960a-eb9ac01a0554 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:20.881390 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18fc7057-3e92-4f61-960a-eb9ac01a0554 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:20.882717 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18fc7057-3e92-4f61-960a-eb9ac01a0554 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:20.883237 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18fc7057-3e92-4f61-960a-eb9ac01a0554 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:20.883665 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18fc7057-3e92-4f61-960a-eb9ac01a0554 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:21.098641 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-18fc7057-3e92-4f61-960a-eb9ac01a0554 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:21.106516 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-18fc7057-3e92-4f61-960a-eb9ac01a0554 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1319 microversion: 2.1 time: 0.242346 Aug 05 07:28:21.107419 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 597/1207] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:20 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:22.128840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-abd931b0-0d06-4957-8973-afa13cb0af7b tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:22.130287 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-abd931b0-0d06-4957-8973-afa13cb0af7b tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:22.137276 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-abd931b0-0d06-4957-8973-afa13cb0af7b tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:22.138026 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-abd931b0-0d06-4957-8973-afa13cb0af7b tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:22.138690 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-abd931b0-0d06-4957-8973-afa13cb0af7b tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:22.139613 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-abd931b0-0d06-4957-8973-afa13cb0af7b tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:22.140315 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-abd931b0-0d06-4957-8973-afa13cb0af7b tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:22.141130 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-abd931b0-0d06-4957-8973-afa13cb0af7b tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:22.322077 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-abd931b0-0d06-4957-8973-afa13cb0af7b tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:22.330320 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-abd931b0-0d06-4957-8973-afa13cb0af7b tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1319 microversion: 2.1 time: 0.206290 Aug 05 07:28:22.331027 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 611/1208] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:22 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:23.352007 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8eb3010e-5705-46ed-9978-c5b621607bbc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:23.352603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8eb3010e-5705-46ed-9978-c5b621607bbc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:23.359480 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8eb3010e-5705-46ed-9978-c5b621607bbc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:23.359962 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8eb3010e-5705-46ed-9978-c5b621607bbc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:23.360390 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8eb3010e-5705-46ed-9978-c5b621607bbc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:23.361199 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8eb3010e-5705-46ed-9978-c5b621607bbc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:23.361985 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8eb3010e-5705-46ed-9978-c5b621607bbc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:23.362422 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8eb3010e-5705-46ed-9978-c5b621607bbc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:23.508042 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8eb3010e-5705-46ed-9978-c5b621607bbc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:23.518147 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8eb3010e-5705-46ed-9978-c5b621607bbc tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1507 microversion: 2.1 time: 0.169996 Aug 05 07:28:23.519435 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 598/1209] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:23 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:23.549547 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-26a1404a-37db-4d30-8583-26e53b6c5ecb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f41cc30-c5e3-4fdb-83b2-027ad889e386", "device": "/dev/sdb"}} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:28:23.553626 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-26a1404a-37db-4d30-8583-26e53b6c5ecb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:23.561029 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26a1404a-37db-4d30-8583-26e53b6c5ecb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:23.561500 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26a1404a-37db-4d30-8583-26e53b6c5ecb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:23.561926 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26a1404a-37db-4d30-8583-26e53b6c5ecb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:23.562611 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26a1404a-37db-4d30-8583-26e53b6c5ecb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:23.563053 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26a1404a-37db-4d30-8583-26e53b6c5ecb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:23.563489 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26a1404a-37db-4d30-8583-26e53b6c5ecb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:23.926582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-26a1404a-37db-4d30-8583-26e53b6c5ecb tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "POST /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384335 Aug 05 07:28:23.927315 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 612/1210] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Aug 5 07:28:23 2022] POST /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:28:46.180731 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-740178300", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-598412302", "security_groups": [{"name": "tempest-secgroup-smoke-160447991"}], "networks": [{"uuid": "dd40e1d2-797b-4768-af13-cd76a1a511f1"}], "block_device_mapping_v2": [{"uuid": "77875cf3-d9ff-4b30-9ae3-f247048e36c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:28:46.192377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=36 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:46.193068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:46.310837 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] validate_networks() for [('dd40e1d2-797b-4768-af13-cd76a1a511f1', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 07:28:46.878429 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 07:28:46.879259 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 07:28:46.880241 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 07:28:46.881304 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 07:28:46.881887 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 07:28:46.895296 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:46.895968 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:46.896563 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:46.897700 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:46.898261 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:46.898747 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:46.920318 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Getting quotas for project 3cb5b787fed94e7091a4ff793951d8f0. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 07:28:46.925159 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Getting quotas for user 4fbc21934e84415e93f29aa5073716f7 and project 3cb5b787fed94e7091a4ff793951d8f0. Resources: {'ram', 'cores', 'instances'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 07:28:46.989652 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 07:28:46.991767 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77875cf3-d9ff-4b30-9ae3-f247048e36c0',volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 07:28:47.127125 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ce882027-b2d0-459b-a09c-4d01bebda1bf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.952821 Aug 05 07:28:47.127775 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 599/1211] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Aug 5 07:28:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 07:28:47.139887 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-844cd13e-85ae-4450-9c7c-c838d75525cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:47.140537 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-844cd13e-85ae-4450-9c7c-c838d75525cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:47.143050 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=10 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:47.143941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:47.144522 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:47.204663 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-844cd13e-85ae-4450-9c7c-c838d75525cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:47.212356 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-844cd13e-85ae-4450-9c7c-c838d75525cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1087 microversion: 2.1 time: 0.076662 Aug 05 07:28:47.213131 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 613/1212] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:47 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:48.234673 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9bb1c21e-18bf-455c-9443-1a515bb949ac tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:48.235305 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9bb1c21e-18bf-455c-9443-1a515bb949ac tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:48.245072 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9bb1c21e-18bf-455c-9443-1a515bb949ac tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:48.245681 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9bb1c21e-18bf-455c-9443-1a515bb949ac tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:48.246130 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9bb1c21e-18bf-455c-9443-1a515bb949ac tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:48.246863 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9bb1c21e-18bf-455c-9443-1a515bb949ac tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:48.247314 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9bb1c21e-18bf-455c-9443-1a515bb949ac tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:48.247750 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9bb1c21e-18bf-455c-9443-1a515bb949ac tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:48.327361 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9bb1c21e-18bf-455c-9443-1a515bb949ac tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:48.335512 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9bb1c21e-18bf-455c-9443-1a515bb949ac tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1193 microversion: 2.1 time: 0.105432 Aug 05 07:28:48.336226 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 600/1213] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:48 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:48.599587 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4c051214-6a6e-4709-bc9d-1acf717e3974 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:48.600160 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4c051214-6a6e-4709-bc9d-1acf717e3974 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:48.607543 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4c051214-6a6e-4709-bc9d-1acf717e3974 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:48.608308 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4c051214-6a6e-4709-bc9d-1acf717e3974 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:48.609044 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4c051214-6a6e-4709-bc9d-1acf717e3974 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:48.609946 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4c051214-6a6e-4709-bc9d-1acf717e3974 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:48.610565 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4c051214-6a6e-4709-bc9d-1acf717e3974 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:48.611175 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4c051214-6a6e-4709-bc9d-1acf717e3974 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:48.696363 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.objects.instance [None req-4c051214-6a6e-4709-bc9d-1acf717e3974 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lazy-loading 'services' on Instance uuid dec21dc7-55fb-4e5a-9f05-01466119ed1c {{(pid=117894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:28:48.776106 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4c051214-6a6e-4709-bc9d-1acf717e3974 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c/os-volume_attachments/5f41cc30-c5e3-4fdb-83b2-027ad889e386" status: 202 len: 0 microversion: 2.1 time: 0.180455 Aug 05 07:28:48.776701 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 614/1214] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Aug 5 07:28:48 2022] DELETE /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c/os-volume_attachments/5f41cc30-c5e3-4fdb-83b2-027ad889e386 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:28:49.359158 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-926c6c64-d7be-4cdb-bbf8-c9dd852eda22 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:49.360165 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-926c6c64-d7be-4cdb-bbf8-c9dd852eda22 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:49.367154 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-926c6c64-d7be-4cdb-bbf8-c9dd852eda22 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:49.367641 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-926c6c64-d7be-4cdb-bbf8-c9dd852eda22 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:49.368103 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-926c6c64-d7be-4cdb-bbf8-c9dd852eda22 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:49.368830 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-926c6c64-d7be-4cdb-bbf8-c9dd852eda22 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:49.369327 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-926c6c64-d7be-4cdb-bbf8-c9dd852eda22 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:49.369851 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-926c6c64-d7be-4cdb-bbf8-c9dd852eda22 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:49.708515 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-926c6c64-d7be-4cdb-bbf8-c9dd852eda22 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:49.716306 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-926c6c64-d7be-4cdb-bbf8-c9dd852eda22 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1270 microversion: 2.1 time: 0.363677 Aug 05 07:28:49.716982 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 601/1215] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:49 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1270 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:49.790228 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-d3588248-a11b-4d6f-a76b-a5a64c35d29b req-c0a764e6-4ced-49b3-91da-237f2c2cea6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54a893a-a853-4d14-a8ce-0e35b78295a8", "tag": "55b585c5-4448-4135-aed9-c84f9d38c42b"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:28:49.805437 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-d3588248-a11b-4d6f-a76b-a5a64c35d29b req-c0a764e6-4ced-49b3-91da-237f2c2cea6e service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:49.805995 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-d3588248-a11b-4d6f-a76b-a5a64c35d29b req-c0a764e6-4ced-49b3-91da-237f2c2cea6e service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:49.806462 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-d3588248-a11b-4d6f-a76b-a5a64c35d29b req-c0a764e6-4ced-49b3-91da-237f2c2cea6e service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:49.821274 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-d3588248-a11b-4d6f-a76b-a5a64c35d29b req-c0a764e6-4ced-49b3-91da-237f2c2cea6e service nova] Creating event network-changed:55b585c5-4448-4135-aed9-c84f9d38c42b for instance d54a893a-a853-4d14-a8ce-0e35b78295a8 on hv-cinder-85200 Aug 05 07:28:49.826258 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-d3588248-a11b-4d6f-a76b-a5a64c35d29b req-c0a764e6-4ced-49b3-91da-237f2c2cea6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043141 Aug 05 07:28:49.826866 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 615/1216] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:28:50.737614 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bd5eb278-6185-4357-b03c-65d51445b928 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:50.738248 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bd5eb278-6185-4357-b03c-65d51445b928 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:50.745190 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd5eb278-6185-4357-b03c-65d51445b928 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:50.745666 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd5eb278-6185-4357-b03c-65d51445b928 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:50.746089 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd5eb278-6185-4357-b03c-65d51445b928 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:50.746781 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd5eb278-6185-4357-b03c-65d51445b928 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:50.747225 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd5eb278-6185-4357-b03c-65d51445b928 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:50.747635 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bd5eb278-6185-4357-b03c-65d51445b928 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:50.890086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bd5eb278-6185-4357-b03c-65d51445b928 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:50.898933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bd5eb278-6185-4357-b03c-65d51445b928 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.165310 Aug 05 07:28:50.899550 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 602/1217] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:50 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:50.978367 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-1cbdda6a-2694-48e4-bf76-53d0c7565481 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:50.979065 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1cbdda6a-2694-48e4-bf76-53d0c7565481 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:50.986311 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1cbdda6a-2694-48e4-bf76-53d0c7565481 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:50.986773 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1cbdda6a-2694-48e4-bf76-53d0c7565481 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:50.987190 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1cbdda6a-2694-48e4-bf76-53d0c7565481 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:50.987887 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1cbdda6a-2694-48e4-bf76-53d0c7565481 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:50.988326 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1cbdda6a-2694-48e4-bf76-53d0c7565481 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:50.988831 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-1cbdda6a-2694-48e4-bf76-53d0c7565481 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:51.015858 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-1cbdda6a-2694-48e4-bf76-53d0c7565481 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Going to try to terminate instance {{(pid=117894) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:28:51.095076 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-1cbdda6a-2694-48e4-bf76-53d0c7565481 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 204 len: 0 microversion: 2.1 time: 0.121040 Aug 05 07:28:51.095725 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 616/1218] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:28:50 2022] DELETE /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:28:51.104683 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ec904e3c-2b93-4594-a254-86dc2444ad3d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:51.105368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ec904e3c-2b93-4594-a254-86dc2444ad3d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:51.111588 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec904e3c-2b93-4594-a254-86dc2444ad3d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:51.112069 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec904e3c-2b93-4594-a254-86dc2444ad3d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:51.112500 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec904e3c-2b93-4594-a254-86dc2444ad3d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:51.113230 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec904e3c-2b93-4594-a254-86dc2444ad3d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:51.113675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec904e3c-2b93-4594-a254-86dc2444ad3d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:51.114093 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec904e3c-2b93-4594-a254-86dc2444ad3d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:51.268575 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ec904e3c-2b93-4594-a254-86dc2444ad3d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:51.277836 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ec904e3c-2b93-4594-a254-86dc2444ad3d tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1513 microversion: 2.1 time: 0.177039 Aug 05 07:28:51.278435 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 603/1219] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:51 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:51.920716 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c1e9dcc8-90c4-45cf-aefd-35a4653f5085 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:51.921471 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c1e9dcc8-90c4-45cf-aefd-35a4653f5085 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:51.928276 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c1e9dcc8-90c4-45cf-aefd-35a4653f5085 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:51.928755 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c1e9dcc8-90c4-45cf-aefd-35a4653f5085 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:51.929247 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c1e9dcc8-90c4-45cf-aefd-35a4653f5085 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:51.929951 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c1e9dcc8-90c4-45cf-aefd-35a4653f5085 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:51.930406 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c1e9dcc8-90c4-45cf-aefd-35a4653f5085 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:51.930812 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c1e9dcc8-90c4-45cf-aefd-35a4653f5085 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:52.132131 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c1e9dcc8-90c4-45cf-aefd-35a4653f5085 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:52.140613 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c1e9dcc8-90c4-45cf-aefd-35a4653f5085 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.224347 Aug 05 07:28:52.141232 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 617/1220] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:51 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:52.303474 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-15df1dae-8594-4b05-894b-5a0961f73126 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:52.304055 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-15df1dae-8594-4b05-894b-5a0961f73126 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:52.321535 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-15df1dae-8594-4b05-894b-5a0961f73126 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:52.322024 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-15df1dae-8594-4b05-894b-5a0961f73126 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:52.322458 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-15df1dae-8594-4b05-894b-5a0961f73126 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:52.323163 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-15df1dae-8594-4b05-894b-5a0961f73126 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:52.323615 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-15df1dae-8594-4b05-894b-5a0961f73126 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:52.324031 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-15df1dae-8594-4b05-894b-5a0961f73126 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:52.480219 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-15df1dae-8594-4b05-894b-5a0961f73126 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:52.488419 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-15df1dae-8594-4b05-894b-5a0961f73126 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1513 microversion: 2.1 time: 0.188878 Aug 05 07:28:52.489020 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 604/1221] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:52 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:53.161840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-7318ea3d-27d7-4604-a753-947062825319 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:53.162452 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-7318ea3d-27d7-4604-a753-947062825319 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:53.169384 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7318ea3d-27d7-4604-a753-947062825319 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:53.170179 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7318ea3d-27d7-4604-a753-947062825319 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:53.170616 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7318ea3d-27d7-4604-a753-947062825319 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:53.171331 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7318ea3d-27d7-4604-a753-947062825319 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:53.171786 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7318ea3d-27d7-4604-a753-947062825319 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:53.172178 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-7318ea3d-27d7-4604-a753-947062825319 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:53.314126 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-7318ea3d-27d7-4604-a753-947062825319 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:53.322308 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-7318ea3d-27d7-4604-a753-947062825319 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.164408 Aug 05 07:28:53.322858 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 618/1222] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:53 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:53.510435 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-df356448-0e27-45f2-94c7-3e0a2716d771 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:53.511024 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-df356448-0e27-45f2-94c7-3e0a2716d771 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:53.517851 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df356448-0e27-45f2-94c7-3e0a2716d771 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:53.518336 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df356448-0e27-45f2-94c7-3e0a2716d771 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:53.518764 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df356448-0e27-45f2-94c7-3e0a2716d771 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:53.519461 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df356448-0e27-45f2-94c7-3e0a2716d771 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:53.519907 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df356448-0e27-45f2-94c7-3e0a2716d771 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:53.520325 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df356448-0e27-45f2-94c7-3e0a2716d771 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:53.725083 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-df356448-0e27-45f2-94c7-3e0a2716d771 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8662b6620724850b0bae866c518a100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b80306557f466c911aba552768c24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:53.733265 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-df356448-0e27-45f2-94c7-3e0a2716d771 tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 200 len: 1513 microversion: 2.1 time: 0.226718 Aug 05 07:28:53.734103 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 605/1223] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:53 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:53.918259 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-04cc55b7-8317-4036-9599-1905437d30f1 req-4dfe227a-3ab4-4dbf-9189-3fa2b612fd62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec21dc7-55fb-4e5a-9f05-01466119ed1c", "name": "network-vif-deleted", "tag": "439ecc81-487f-469f-b6b9-0ed1dcea25d7"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:28:53.928649 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-04cc55b7-8317-4036-9599-1905437d30f1 req-4dfe227a-3ab4-4dbf-9189-3fa2b612fd62 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:53.929152 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-04cc55b7-8317-4036-9599-1905437d30f1 req-4dfe227a-3ab4-4dbf-9189-3fa2b612fd62 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:53.929570 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-04cc55b7-8317-4036-9599-1905437d30f1 req-4dfe227a-3ab4-4dbf-9189-3fa2b612fd62 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:53.941280 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-04cc55b7-8317-4036-9599-1905437d30f1 req-4dfe227a-3ab4-4dbf-9189-3fa2b612fd62 service nova] Creating event network-vif-deleted:439ecc81-487f-469f-b6b9-0ed1dcea25d7 for instance dec21dc7-55fb-4e5a-9f05-01466119ed1c on hv-cinder-85200 Aug 05 07:28:53.946432 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-04cc55b7-8317-4036-9599-1905437d30f1 req-4dfe227a-3ab4-4dbf-9189-3fa2b612fd62 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033202 Aug 05 07:28:53.947150 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 619/1224] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:28:54.343185 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c4236cc4-8ba5-44aa-ac27-bfc6771d5f6c tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:54.343886 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c4236cc4-8ba5-44aa-ac27-bfc6771d5f6c tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:54.350394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4236cc4-8ba5-44aa-ac27-bfc6771d5f6c tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:54.350920 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4236cc4-8ba5-44aa-ac27-bfc6771d5f6c tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:54.351349 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4236cc4-8ba5-44aa-ac27-bfc6771d5f6c tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:54.352114 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4236cc4-8ba5-44aa-ac27-bfc6771d5f6c tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:54.352535 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4236cc4-8ba5-44aa-ac27-bfc6771d5f6c tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:54.352977 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4236cc4-8ba5-44aa-ac27-bfc6771d5f6c tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:54.496151 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c4236cc4-8ba5-44aa-ac27-bfc6771d5f6c tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:54.504166 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c4236cc4-8ba5-44aa-ac27-bfc6771d5f6c tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.164968 Aug 05 07:28:54.504735 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 606/1225] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:54 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:54.757808 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5cfc7614-26f5-449e-853d-32240f637b3a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:54.758511 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5cfc7614-26f5-449e-853d-32240f637b3a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] [instance: dec21dc7-55fb-4e5a-9f05-01466119ed1c] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:54.765408 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5cfc7614-26f5-449e-853d-32240f637b3a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:54.765889 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5cfc7614-26f5-449e-853d-32240f637b3a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:54.766322 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5cfc7614-26f5-449e-853d-32240f637b3a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:54.767017 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5cfc7614-26f5-449e-853d-32240f637b3a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:54.767476 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5cfc7614-26f5-449e-853d-32240f637b3a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:54.767891 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5cfc7614-26f5-449e-853d-32240f637b3a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:54.781546 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-5cfc7614-26f5-449e-853d-32240f637b3a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] HTTP exception thrown: Instance dec21dc7-55fb-4e5a-9f05-01466119ed1c could not be found. Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5cfc7614-26f5-449e-853d-32240f637b3a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Request method failure captured: Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c HTTP/1.1 Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MYOSgAHQ4kGVVXZKkZoRKE6saYqs6vR9HOojqIlAgkpehrt81Jw5f8xJaVCSgR4v-H91KNXrrwF2uw1OTra-9lnhcxl7QlZhZ5SFd1lKDZv-9v4CQL3zDHz3n2uK7CvIFnAkPoGxpE0An2s_DSWSEE9YukN85UEi5Kf6ijQGQKeMbY Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: f5b80306557f466c911aba552768c24e Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1154421679 Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:28:54.783254 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:28:54.785074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f5b80306557f466c911aba552768c24e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5b80306557f466c911aba552768c24e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5b80306557f466c911aba552768c24e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f5b80306557f466c911aba552768c24e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:28:54.785074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-VolumesSnapshotTestJSON-1154421679 Aug 05 07:28:54.785074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: f5b80306557f466c911aba552768c24e Aug 05 07:28:54.785074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1154421679 Aug 05 07:28:54.785074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-VolumesSnapshotTestJSON-1154421679-project Aug 05 07:28:54.785074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:28:54.785074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:28:54.785074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: a8662b6620724850b0bae866c518a100 Aug 05 07:28:54.785074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-VolumesSnapshotTestJSON-1154421679-project Aug 05 07:28:54.785074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:28:54.785074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance dec21dc7-55fb-4e5a-9f05-01466119ed1c could not be found. Aug 05 07:28:54.785074 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'dec21dc7-55fb-4e5a-9f05-01466119ed1c'} Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec21dc7-55fb-4e5a-9f05-01466119ed1c could not be found. Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:28:54.786420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec21dc7-55fb-4e5a-9f05-01466119ed1c could not be found. Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec21dc7-55fb-4e5a-9f05-01466119ed1c could not be found. Aug 05 07:28:54.788485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:28:54.790161 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5cfc7614-26f5-449e-853d-32240f637b3a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] Returning 404 to user: Instance dec21dc7-55fb-4e5a-9f05-01466119ed1c could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:28:54.790161 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5cfc7614-26f5-449e-853d-32240f637b3a tempest-VolumesSnapshotTestJSON-1154421679 tempest-VolumesSnapshotTestJSON-1154421679-project] 10.222.0.27 "GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c" status: 404 len: 111 microversion: 2.1 time: 0.032099 Aug 05 07:28:54.790161 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 620/1226] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:54 2022] GET /compute/v2.1/servers/dec21dc7-55fb-4e5a-9f05-01466119ed1c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:28:55.527249 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d0e2a089-7838-48c9-aba0-104de3f935cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:55.528021 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d0e2a089-7838-48c9-aba0-104de3f935cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:55.536226 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0e2a089-7838-48c9-aba0-104de3f935cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:55.536705 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0e2a089-7838-48c9-aba0-104de3f935cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:55.537164 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0e2a089-7838-48c9-aba0-104de3f935cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:55.537853 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0e2a089-7838-48c9-aba0-104de3f935cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:55.538303 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0e2a089-7838-48c9-aba0-104de3f935cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:55.538721 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0e2a089-7838-48c9-aba0-104de3f935cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:55.687263 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d0e2a089-7838-48c9-aba0-104de3f935cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:55.695446 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d0e2a089-7838-48c9-aba0-104de3f935cd tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.173203 Aug 05 07:28:55.696045 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 607/1227] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:55 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:56.716429 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-0d780e96-84b1-4f32-8076-0a4e56c26031 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:56.717069 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-0d780e96-84b1-4f32-8076-0a4e56c26031 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:56.724025 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0d780e96-84b1-4f32-8076-0a4e56c26031 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:56.724502 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0d780e96-84b1-4f32-8076-0a4e56c26031 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:56.724932 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0d780e96-84b1-4f32-8076-0a4e56c26031 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:56.725639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0d780e96-84b1-4f32-8076-0a4e56c26031 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:56.726103 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0d780e96-84b1-4f32-8076-0a4e56c26031 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:56.726514 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-0d780e96-84b1-4f32-8076-0a4e56c26031 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:56.868812 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-0d780e96-84b1-4f32-8076-0a4e56c26031 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:56.876473 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-0d780e96-84b1-4f32-8076-0a4e56c26031 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.164045 Aug 05 07:28:56.877109 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 621/1228] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:56 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:57.903488 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d3799303-cc1f-48fb-bd74-c945a4a73c39 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:57.904068 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d3799303-cc1f-48fb-bd74-c945a4a73c39 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:57.906388 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:57.907062 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:57.913255 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d3799303-cc1f-48fb-bd74-c945a4a73c39 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:57.913734 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d3799303-cc1f-48fb-bd74-c945a4a73c39 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:57.914197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d3799303-cc1f-48fb-bd74-c945a4a73c39 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:57.914885 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d3799303-cc1f-48fb-bd74-c945a4a73c39 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:57.915357 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d3799303-cc1f-48fb-bd74-c945a4a73c39 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:57.915770 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d3799303-cc1f-48fb-bd74-c945a4a73c39 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:58.053336 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d3799303-cc1f-48fb-bd74-c945a4a73c39 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:58.064861 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d3799303-cc1f-48fb-bd74-c945a4a73c39 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.165422 Aug 05 07:28:58.065470 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 608/1229] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:57 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:28:59.087595 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-27664e1d-b9c1-4b36-a7f1-d44b75b8a771 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:28:59.088198 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-27664e1d-b9c1-4b36-a7f1-d44b75b8a771 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:28:59.090300 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell0:SELECT=2 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:59.096494 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-27664e1d-b9c1-4b36-a7f1-d44b75b8a771 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:59.096982 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-27664e1d-b9c1-4b36-a7f1-d44b75b8a771 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:59.097443 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-27664e1d-b9c1-4b36-a7f1-d44b75b8a771 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:59.098135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-27664e1d-b9c1-4b36-a7f1-d44b75b8a771 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:28:59.098586 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-27664e1d-b9c1-4b36-a7f1-d44b75b8a771 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:28:59.099011 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-27664e1d-b9c1-4b36-a7f1-d44b75b8a771 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:28:59.244596 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-27664e1d-b9c1-4b36-a7f1-d44b75b8a771 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:28:59.254883 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-27664e1d-b9c1-4b36-a7f1-d44b75b8a771 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.171263 Aug 05 07:28:59.255807 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 622/1230] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:28:59 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:00.278183 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8ae9f066-109a-40f9-809c-e9d9e8ffb3ba tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:29:00.278802 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8ae9f066-109a-40f9-809c-e9d9e8ffb3ba tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:29:00.285704 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ae9f066-109a-40f9-809c-e9d9e8ffb3ba tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:00.286197 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ae9f066-109a-40f9-809c-e9d9e8ffb3ba tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:00.286651 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ae9f066-109a-40f9-809c-e9d9e8ffb3ba tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:00.287354 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ae9f066-109a-40f9-809c-e9d9e8ffb3ba tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:00.287808 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ae9f066-109a-40f9-809c-e9d9e8ffb3ba tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:00.288228 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8ae9f066-109a-40f9-809c-e9d9e8ffb3ba tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:00.434202 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8ae9f066-109a-40f9-809c-e9d9e8ffb3ba tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:29:00.442394 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8ae9f066-109a-40f9-809c-e9d9e8ffb3ba tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.169985 Aug 05 07:29:00.442930 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 609/1231] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:29:00 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:01.462424 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-5fc0a300-5fde-43bd-aba8-076797af7e85 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:29:01.463072 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-5fc0a300-5fde-43bd-aba8-076797af7e85 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:29:01.470092 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5fc0a300-5fde-43bd-aba8-076797af7e85 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:01.470569 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5fc0a300-5fde-43bd-aba8-076797af7e85 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:01.470997 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5fc0a300-5fde-43bd-aba8-076797af7e85 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:01.471694 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5fc0a300-5fde-43bd-aba8-076797af7e85 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:01.472142 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5fc0a300-5fde-43bd-aba8-076797af7e85 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:01.472657 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-5fc0a300-5fde-43bd-aba8-076797af7e85 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:01.617612 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-5fc0a300-5fde-43bd-aba8-076797af7e85 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:29:01.629990 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-5fc0a300-5fde-43bd-aba8-076797af7e85 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.171523 Aug 05 07:29:01.630931 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 623/1232] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:29:01 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:02.651494 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dbc9d4b0-3466-4775-82e8-0bc1b2d6acb7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:29:02.652057 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dbc9d4b0-3466-4775-82e8-0bc1b2d6acb7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:29:02.659338 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dbc9d4b0-3466-4775-82e8-0bc1b2d6acb7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:02.659863 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dbc9d4b0-3466-4775-82e8-0bc1b2d6acb7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:02.660294 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dbc9d4b0-3466-4775-82e8-0bc1b2d6acb7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:02.661064 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dbc9d4b0-3466-4775-82e8-0bc1b2d6acb7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:02.661519 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dbc9d4b0-3466-4775-82e8-0bc1b2d6acb7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:02.661940 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dbc9d4b0-3466-4775-82e8-0bc1b2d6acb7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:02.806833 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dbc9d4b0-3466-4775-82e8-0bc1b2d6acb7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:29:02.814992 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-dbc9d4b0-3466-4775-82e8-0bc1b2d6acb7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.167594 Aug 05 07:29:02.815552 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 610/1233] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:29:02 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:03.838550 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-45df50fc-a16d-44e3-b65f-cc0cb09b84e2 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:29:03.839438 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-45df50fc-a16d-44e3-b65f-cc0cb09b84e2 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:29:03.848815 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45df50fc-a16d-44e3-b65f-cc0cb09b84e2 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:03.849327 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45df50fc-a16d-44e3-b65f-cc0cb09b84e2 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:03.849756 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45df50fc-a16d-44e3-b65f-cc0cb09b84e2 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:03.850445 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45df50fc-a16d-44e3-b65f-cc0cb09b84e2 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:03.850891 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45df50fc-a16d-44e3-b65f-cc0cb09b84e2 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:03.851302 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-45df50fc-a16d-44e3-b65f-cc0cb09b84e2 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:03.998191 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-45df50fc-a16d-44e3-b65f-cc0cb09b84e2 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:29:04.006798 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-45df50fc-a16d-44e3-b65f-cc0cb09b84e2 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.173611 Aug 05 07:29:04.007340 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 624/1234] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:29:03 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:05.027953 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2895fefb-585b-41b5-81ac-da0b5a14f982 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:29:05.028585 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2895fefb-585b-41b5-81ac-da0b5a14f982 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:29:05.035255 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2895fefb-585b-41b5-81ac-da0b5a14f982 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:05.035724 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2895fefb-585b-41b5-81ac-da0b5a14f982 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:05.036157 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2895fefb-585b-41b5-81ac-da0b5a14f982 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:05.036854 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2895fefb-585b-41b5-81ac-da0b5a14f982 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:05.037331 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2895fefb-585b-41b5-81ac-da0b5a14f982 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:05.037806 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2895fefb-585b-41b5-81ac-da0b5a14f982 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:05.180377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2895fefb-585b-41b5-81ac-da0b5a14f982 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:29:05.189989 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2895fefb-585b-41b5-81ac-da0b5a14f982 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.166261 Aug 05 07:29:05.190553 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 611/1235] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:29:05 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:06.211156 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-babd8419-9d8f-4eb9-b661-4473a4e94aaf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:29:06.211793 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-babd8419-9d8f-4eb9-b661-4473a4e94aaf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:29:06.219137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-babd8419-9d8f-4eb9-b661-4473a4e94aaf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:06.219620 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-babd8419-9d8f-4eb9-b661-4473a4e94aaf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:06.220043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-babd8419-9d8f-4eb9-b661-4473a4e94aaf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:06.220736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-babd8419-9d8f-4eb9-b661-4473a4e94aaf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:06.221213 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-babd8419-9d8f-4eb9-b661-4473a4e94aaf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:06.221630 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-babd8419-9d8f-4eb9-b661-4473a4e94aaf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:06.362115 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-babd8419-9d8f-4eb9-b661-4473a4e94aaf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:29:06.369901 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-babd8419-9d8f-4eb9-b661-4473a4e94aaf tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.162746 Aug 05 07:29:06.370456 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 625/1236] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:29:06 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:07.391973 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-22aa516b-880b-446d-84c4-88f40acd7f29 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:29:07.392611 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-22aa516b-880b-446d-84c4-88f40acd7f29 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:29:07.400308 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22aa516b-880b-446d-84c4-88f40acd7f29 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:07.400847 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22aa516b-880b-446d-84c4-88f40acd7f29 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:07.401377 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22aa516b-880b-446d-84c4-88f40acd7f29 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:07.402181 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22aa516b-880b-446d-84c4-88f40acd7f29 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:07.402675 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22aa516b-880b-446d-84c4-88f40acd7f29 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:07.403161 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22aa516b-880b-446d-84c4-88f40acd7f29 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:07.545546 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-22aa516b-880b-446d-84c4-88f40acd7f29 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:29:07.554903 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-22aa516b-880b-446d-84c4-88f40acd7f29 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.167608 Aug 05 07:29:07.555512 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 612/1237] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:29:07 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:08.575430 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-28272811-1720-4f9f-b9d6-fe20bc89fa98 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:29:08.575990 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-28272811-1720-4f9f-b9d6-fe20bc89fa98 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:29:08.583019 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-28272811-1720-4f9f-b9d6-fe20bc89fa98 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:08.583491 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-28272811-1720-4f9f-b9d6-fe20bc89fa98 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:08.583920 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-28272811-1720-4f9f-b9d6-fe20bc89fa98 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:08.584729 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-28272811-1720-4f9f-b9d6-fe20bc89fa98 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:08.585252 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-28272811-1720-4f9f-b9d6-fe20bc89fa98 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:08.585706 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-28272811-1720-4f9f-b9d6-fe20bc89fa98 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:08.742498 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-28272811-1720-4f9f-b9d6-fe20bc89fa98 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:29:08.750852 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-28272811-1720-4f9f-b9d6-fe20bc89fa98 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.179313 Aug 05 07:29:08.751571 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 626/1238] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:29:08 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:09.666336 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-b7c941e0-12b0-4c5e-ac60-dcc5b4a0df66 req-016f498e-dec1-4edf-8f0c-473f0e63ca71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54a893a-a853-4d14-a8ce-0e35b78295a8", "name": "network-vif-plugged", "status": "completed", "tag": "55b585c5-4448-4135-aed9-c84f9d38c42b"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:29:09.676604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-b7c941e0-12b0-4c5e-ac60-dcc5b4a0df66 req-016f498e-dec1-4edf-8f0c-473f0e63ca71 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:09.677080 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-b7c941e0-12b0-4c5e-ac60-dcc5b4a0df66 req-016f498e-dec1-4edf-8f0c-473f0e63ca71 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:09.677507 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-b7c941e0-12b0-4c5e-ac60-dcc5b4a0df66 req-016f498e-dec1-4edf-8f0c-473f0e63ca71 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:09.689475 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-b7c941e0-12b0-4c5e-ac60-dcc5b4a0df66 req-016f498e-dec1-4edf-8f0c-473f0e63ca71 service nova] Creating event network-vif-plugged:55b585c5-4448-4135-aed9-c84f9d38c42b for instance d54a893a-a853-4d14-a8ce-0e35b78295a8 on hv-cinder-85200 Aug 05 07:29:09.694921 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-b7c941e0-12b0-4c5e-ac60-dcc5b4a0df66 req-016f498e-dec1-4edf-8f0c-473f0e63ca71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032369 Aug 05 07:29:09.695634 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 613/1239] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:29:09.772804 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-db01584c-1946-4f18-837b-dfaa39a5a24e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:29:09.773442 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-db01584c-1946-4f18-837b-dfaa39a5a24e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:29:09.780466 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db01584c-1946-4f18-837b-dfaa39a5a24e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:09.780954 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db01584c-1946-4f18-837b-dfaa39a5a24e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:09.781412 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db01584c-1946-4f18-837b-dfaa39a5a24e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:09.782112 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db01584c-1946-4f18-837b-dfaa39a5a24e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:09.782546 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db01584c-1946-4f18-837b-dfaa39a5a24e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:09.782965 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db01584c-1946-4f18-837b-dfaa39a5a24e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:09.923382 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-db01584c-1946-4f18-837b-dfaa39a5a24e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:29:09.932474 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-db01584c-1946-4f18-837b-dfaa39a5a24e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.164698 Aug 05 07:29:09.933138 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 627/1240] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:29:09 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:10.955430 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-97e84cc3-c424-4d22-a420-c9f18ae944d8 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:29:10.956059 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-97e84cc3-c424-4d22-a420-c9f18ae944d8 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:29:10.962921 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97e84cc3-c424-4d22-a420-c9f18ae944d8 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:10.963396 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97e84cc3-c424-4d22-a420-c9f18ae944d8 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:10.963813 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97e84cc3-c424-4d22-a420-c9f18ae944d8 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:10.964491 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97e84cc3-c424-4d22-a420-c9f18ae944d8 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:10.964931 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97e84cc3-c424-4d22-a420-c9f18ae944d8 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:10.965372 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97e84cc3-c424-4d22-a420-c9f18ae944d8 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:11.115596 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-97e84cc3-c424-4d22-a420-c9f18ae944d8 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:29:11.123832 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-97e84cc3-c424-4d22-a420-c9f18ae944d8 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1258 microversion: 2.1 time: 0.173227 Aug 05 07:29:11.124410 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 614/1241] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:29:10 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:12.144752 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-9065ec98-cdf6-4ea0-b680-6a48f35d88bc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:29:12.145439 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-9065ec98-cdf6-4ea0-b680-6a48f35d88bc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:29:12.152503 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9065ec98-cdf6-4ea0-b680-6a48f35d88bc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:12.153010 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9065ec98-cdf6-4ea0-b680-6a48f35d88bc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:12.153439 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9065ec98-cdf6-4ea0-b680-6a48f35d88bc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:12.154145 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9065ec98-cdf6-4ea0-b680-6a48f35d88bc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:12.154597 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9065ec98-cdf6-4ea0-b680-6a48f35d88bc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:12.155018 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-9065ec98-cdf6-4ea0-b680-6a48f35d88bc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:12.294415 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-9065ec98-cdf6-4ea0-b680-6a48f35d88bc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:29:12.302320 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-9065ec98-cdf6-4ea0-b680-6a48f35d88bc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1442 microversion: 2.1 time: 0.161571 Aug 05 07:29:12.302886 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 628/1242] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:29:12 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:12.322223 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fc10e2b9-c8a5-46e0-b1dc-e9b019870b6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:29:12.322837 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fc10e2b9-c8a5-46e0-b1dc-e9b019870b6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:29:12.329641 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fc10e2b9-c8a5-46e0-b1dc-e9b019870b6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:12.330114 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fc10e2b9-c8a5-46e0-b1dc-e9b019870b6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:12.330554 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fc10e2b9-c8a5-46e0-b1dc-e9b019870b6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:12.331221 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fc10e2b9-c8a5-46e0-b1dc-e9b019870b6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:12.331665 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fc10e2b9-c8a5-46e0-b1dc-e9b019870b6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:12.332077 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fc10e2b9-c8a5-46e0-b1dc-e9b019870b6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:12.473436 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fc10e2b9-c8a5-46e0-b1dc-e9b019870b6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:29:12.481218 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fc10e2b9-c8a5-46e0-b1dc-e9b019870b6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1442 microversion: 2.1 time: 0.162875 Aug 05 07:29:12.482232 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 615/1243] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:29:12 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1442 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:29:14.532419 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-064f44d1-0004-4422-9911-e854494f65d9 req-d318b56a-6dd2-4a3e-92f9-b10712a9baab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54a893a-a853-4d14-a8ce-0e35b78295a8", "tag": "55b585c5-4448-4135-aed9-c84f9d38c42b"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:29:14.542840 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-064f44d1-0004-4422-9911-e854494f65d9 req-d318b56a-6dd2-4a3e-92f9-b10712a9baab service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:29:14.543315 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-064f44d1-0004-4422-9911-e854494f65d9 req-d318b56a-6dd2-4a3e-92f9-b10712a9baab service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:29:14.543741 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-064f44d1-0004-4422-9911-e854494f65d9 req-d318b56a-6dd2-4a3e-92f9-b10712a9baab service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:29:14.555450 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-064f44d1-0004-4422-9911-e854494f65d9 req-d318b56a-6dd2-4a3e-92f9-b10712a9baab service nova] Creating event network-changed:55b585c5-4448-4135-aed9-c84f9d38c42b for instance d54a893a-a853-4d14-a8ce-0e35b78295a8 on hv-cinder-85200 Aug 05 07:29:14.560675 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-064f44d1-0004-4422-9911-e854494f65d9 req-d318b56a-6dd2-4a3e-92f9-b10712a9baab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032137 Aug 05 07:29:14.564492 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 629/1244] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:30:49.546301 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 07:30:49.547008 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Fri Aug 5 07:30:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 07:31:20.578877 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 07:31:20.579539 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Fri Aug 5 07:31:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 07:31:28.343205 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: ERROR oslo.messaging._drivers.impl_rabbit [-] [997f33b0-38aa-418c-a32c-e3db45f27711] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 05 07:31:28.344303 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:31:28.345257 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=94 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:31:28.350625 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-01910e8d-a8d0-42f6-bb9f-37a12467e2ad tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:31:28.351437 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-01910e8d-a8d0-42f6-bb9f-37a12467e2ad tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:28.363368 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01910e8d-a8d0-42f6-bb9f-37a12467e2ad tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:28.363838 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01910e8d-a8d0-42f6-bb9f-37a12467e2ad tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:28.364262 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01910e8d-a8d0-42f6-bb9f-37a12467e2ad tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:28.364950 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01910e8d-a8d0-42f6-bb9f-37a12467e2ad tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:28.365413 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01910e8d-a8d0-42f6-bb9f-37a12467e2ad tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:28.365822 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01910e8d-a8d0-42f6-bb9f-37a12467e2ad tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:28.388842 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-01910e8d-a8d0-42f6-bb9f-37a12467e2ad tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lazy-loading 'flavor' on Instance uuid d54a893a-a853-4d14-a8ce-0e35b78295a8 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 07:31:28.474811 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-01910e8d-a8d0-42f6-bb9f-37a12467e2ad tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "POST /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8/action" status: 202 len: 0 microversion: 2.1 time: 0.133520 Aug 05 07:31:28.475381 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 616/1245] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:31:28 2022] POST /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:31:28.482890 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7f8fa2e-7d1c-4475-ba6c-036d62133a00] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 05 07:31:28.483984 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:31:28.484813 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:31:28.489674 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-05a9300a-5a56-4907-98ed-f492e710f102 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:28.490400 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-05a9300a-5a56-4907-98ed-f492e710f102 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:28.499969 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-05a9300a-5a56-4907-98ed-f492e710f102 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:28.500572 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-05a9300a-5a56-4907-98ed-f492e710f102 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:28.501119 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-05a9300a-5a56-4907-98ed-f492e710f102 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:28.501822 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-05a9300a-5a56-4907-98ed-f492e710f102 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:28.502274 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-05a9300a-5a56-4907-98ed-f492e710f102 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:28.503064 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-05a9300a-5a56-4907-98ed-f492e710f102 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:28.647222 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-05a9300a-5a56-4907-98ed-f492e710f102 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:28.655007 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-05a9300a-5a56-4907-98ed-f492e710f102 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.174361 Aug 05 07:31:28.655562 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 630/1246] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:28 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:29.680843 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e4268e70-aa95-4fd3-95be-0c2b81d34f5a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:29.681473 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e4268e70-aa95-4fd3-95be-0c2b81d34f5a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:29.688475 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e4268e70-aa95-4fd3-95be-0c2b81d34f5a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:29.688992 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e4268e70-aa95-4fd3-95be-0c2b81d34f5a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:29.689405 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e4268e70-aa95-4fd3-95be-0c2b81d34f5a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:29.690086 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e4268e70-aa95-4fd3-95be-0c2b81d34f5a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:29.690526 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e4268e70-aa95-4fd3-95be-0c2b81d34f5a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:29.690919 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e4268e70-aa95-4fd3-95be-0c2b81d34f5a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:29.697033 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] [997f33b0-38aa-418c-a32c-e3db45f27711] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 58608. Aug 05 07:31:29.831857 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e4268e70-aa95-4fd3-95be-0c2b81d34f5a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:29.840192 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e4268e70-aa95-4fd3-95be-0c2b81d34f5a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.166452 Aug 05 07:31:29.840765 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 617/1247] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:29 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:30.863721 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-26c0f405-c07d-40f0-b504-bd3946a09f2b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:30.864485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-26c0f405-c07d-40f0-b504-bd3946a09f2b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:30.876512 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26c0f405-c07d-40f0-b504-bd3946a09f2b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:30.877172 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26c0f405-c07d-40f0-b504-bd3946a09f2b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:30.878099 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26c0f405-c07d-40f0-b504-bd3946a09f2b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:30.879130 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26c0f405-c07d-40f0-b504-bd3946a09f2b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:30.879584 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26c0f405-c07d-40f0-b504-bd3946a09f2b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:30.880003 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-26c0f405-c07d-40f0-b504-bd3946a09f2b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:30.885420 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7f8fa2e-7d1c-4475-ba6c-036d62133a00] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 58612. Aug 05 07:31:31.018664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-26c0f405-c07d-40f0-b504-bd3946a09f2b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:31.031263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-26c0f405-c07d-40f0-b504-bd3946a09f2b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.172837 Aug 05 07:31:31.032043 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 631/1248] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:30 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:32.053426 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-12a21d73-1d52-46bd-a29f-5018e7c6ea6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:32.054046 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-12a21d73-1d52-46bd-a29f-5018e7c6ea6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:32.061431 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12a21d73-1d52-46bd-a29f-5018e7c6ea6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:32.061913 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12a21d73-1d52-46bd-a29f-5018e7c6ea6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:32.062344 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12a21d73-1d52-46bd-a29f-5018e7c6ea6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:32.063035 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12a21d73-1d52-46bd-a29f-5018e7c6ea6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:32.063484 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12a21d73-1d52-46bd-a29f-5018e7c6ea6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:32.063891 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12a21d73-1d52-46bd-a29f-5018e7c6ea6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:32.227505 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-12a21d73-1d52-46bd-a29f-5018e7c6ea6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:32.239509 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-12a21d73-1d52-46bd-a29f-5018e7c6ea6a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.189960 Aug 05 07:31:32.240178 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 618/1249] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:32 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:33.266971 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-17bdad49-c001-44c5-94c3-3db1e6ffd662 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:33.267562 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-17bdad49-c001-44c5-94c3-3db1e6ffd662 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:33.274636 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-17bdad49-c001-44c5-94c3-3db1e6ffd662 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:33.275122 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-17bdad49-c001-44c5-94c3-3db1e6ffd662 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:33.275555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-17bdad49-c001-44c5-94c3-3db1e6ffd662 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:33.276272 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-17bdad49-c001-44c5-94c3-3db1e6ffd662 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:33.276736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-17bdad49-c001-44c5-94c3-3db1e6ffd662 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:33.277222 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-17bdad49-c001-44c5-94c3-3db1e6ffd662 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:33.422582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-17bdad49-c001-44c5-94c3-3db1e6ffd662 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:33.431025 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-17bdad49-c001-44c5-94c3-3db1e6ffd662 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.168021 Aug 05 07:31:33.431604 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 632/1250] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:33 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:34.454203 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-88060e2f-f427-40b5-9ef4-9a722f22d65d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:34.455005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-88060e2f-f427-40b5-9ef4-9a722f22d65d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:34.464163 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-88060e2f-f427-40b5-9ef4-9a722f22d65d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:34.464805 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-88060e2f-f427-40b5-9ef4-9a722f22d65d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:34.465404 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-88060e2f-f427-40b5-9ef4-9a722f22d65d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:34.466384 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-88060e2f-f427-40b5-9ef4-9a722f22d65d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:34.466998 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-88060e2f-f427-40b5-9ef4-9a722f22d65d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:34.467565 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-88060e2f-f427-40b5-9ef4-9a722f22d65d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:34.606339 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-88060e2f-f427-40b5-9ef4-9a722f22d65d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:34.618395 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-88060e2f-f427-40b5-9ef4-9a722f22d65d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.169263 Aug 05 07:31:34.619285 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 619/1251] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:34 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:35.641286 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-651eeef4-4c7b-4b7d-bb46-c6b962e1d897 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:35.641882 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-651eeef4-4c7b-4b7d-bb46-c6b962e1d897 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:35.649079 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-651eeef4-4c7b-4b7d-bb46-c6b962e1d897 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:35.649555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-651eeef4-4c7b-4b7d-bb46-c6b962e1d897 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:35.649986 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-651eeef4-4c7b-4b7d-bb46-c6b962e1d897 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:35.650672 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-651eeef4-4c7b-4b7d-bb46-c6b962e1d897 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:35.651116 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-651eeef4-4c7b-4b7d-bb46-c6b962e1d897 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:35.651534 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-651eeef4-4c7b-4b7d-bb46-c6b962e1d897 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:35.788033 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-651eeef4-4c7b-4b7d-bb46-c6b962e1d897 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:35.800018 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-651eeef4-4c7b-4b7d-bb46-c6b962e1d897 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.162616 Aug 05 07:31:35.800881 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 633/1252] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:35 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:36.823965 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ed5830e3-ea88-4c6a-875a-e62072008388 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:36.824737 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ed5830e3-ea88-4c6a-875a-e62072008388 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:36.833578 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed5830e3-ea88-4c6a-875a-e62072008388 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:36.834179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed5830e3-ea88-4c6a-875a-e62072008388 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:36.834745 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed5830e3-ea88-4c6a-875a-e62072008388 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:36.835644 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed5830e3-ea88-4c6a-875a-e62072008388 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:36.836306 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed5830e3-ea88-4c6a-875a-e62072008388 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:36.836695 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed5830e3-ea88-4c6a-875a-e62072008388 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:36.979305 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ed5830e3-ea88-4c6a-875a-e62072008388 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:36.989226 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ed5830e3-ea88-4c6a-875a-e62072008388 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.170381 Aug 05 07:31:36.989805 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 620/1253] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:36 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:38.015081 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-adfba80f-f897-4f5c-8c87-9cc3249cf54a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:38.016185 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-adfba80f-f897-4f5c-8c87-9cc3249cf54a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:38.026351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adfba80f-f897-4f5c-8c87-9cc3249cf54a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:38.026835 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adfba80f-f897-4f5c-8c87-9cc3249cf54a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:38.027271 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adfba80f-f897-4f5c-8c87-9cc3249cf54a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:38.027967 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adfba80f-f897-4f5c-8c87-9cc3249cf54a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:38.028434 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adfba80f-f897-4f5c-8c87-9cc3249cf54a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:38.028836 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-adfba80f-f897-4f5c-8c87-9cc3249cf54a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:38.171581 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-adfba80f-f897-4f5c-8c87-9cc3249cf54a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:38.179459 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-adfba80f-f897-4f5c-8c87-9cc3249cf54a tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.171113 Aug 05 07:31:38.180396 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 634/1254] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:38 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:39.203913 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a53b8c26-6458-4afc-9fb1-bc744f215dbc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:39.204824 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a53b8c26-6458-4afc-9fb1-bc744f215dbc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:39.214147 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a53b8c26-6458-4afc-9fb1-bc744f215dbc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:39.214630 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a53b8c26-6458-4afc-9fb1-bc744f215dbc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:39.215059 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a53b8c26-6458-4afc-9fb1-bc744f215dbc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:39.215759 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a53b8c26-6458-4afc-9fb1-bc744f215dbc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:39.216210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a53b8c26-6458-4afc-9fb1-bc744f215dbc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:39.216628 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a53b8c26-6458-4afc-9fb1-bc744f215dbc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:39.376032 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a53b8c26-6458-4afc-9fb1-bc744f215dbc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:39.384439 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a53b8c26-6458-4afc-9fb1-bc744f215dbc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.186946 Aug 05 07:31:39.385018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 621/1255] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:39 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:40.414588 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-79eb6763-b989-4be5-9c09-d9fc4bbb55f1 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:40.415434 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-79eb6763-b989-4be5-9c09-d9fc4bbb55f1 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:40.425096 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-79eb6763-b989-4be5-9c09-d9fc4bbb55f1 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:40.425747 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-79eb6763-b989-4be5-9c09-d9fc4bbb55f1 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:40.426349 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-79eb6763-b989-4be5-9c09-d9fc4bbb55f1 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:40.427251 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-79eb6763-b989-4be5-9c09-d9fc4bbb55f1 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:40.427889 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-79eb6763-b989-4be5-9c09-d9fc4bbb55f1 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:40.428490 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-79eb6763-b989-4be5-9c09-d9fc4bbb55f1 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:40.572222 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-79eb6763-b989-4be5-9c09-d9fc4bbb55f1 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:40.584332 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-79eb6763-b989-4be5-9c09-d9fc4bbb55f1 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.175221 Aug 05 07:31:40.584973 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 635/1256] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:40 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:41.607084 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-42de2340-5ed4-4205-9db8-8fae03759b8f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:41.607713 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-42de2340-5ed4-4205-9db8-8fae03759b8f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:41.614638 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-42de2340-5ed4-4205-9db8-8fae03759b8f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:41.615117 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-42de2340-5ed4-4205-9db8-8fae03759b8f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:41.615544 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-42de2340-5ed4-4205-9db8-8fae03759b8f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:41.616238 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-42de2340-5ed4-4205-9db8-8fae03759b8f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:41.616690 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-42de2340-5ed4-4205-9db8-8fae03759b8f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:41.617142 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-42de2340-5ed4-4205-9db8-8fae03759b8f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:41.756524 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-42de2340-5ed4-4205-9db8-8fae03759b8f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:41.764663 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-42de2340-5ed4-4205-9db8-8fae03759b8f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1568 microversion: 2.1 time: 0.161574 Aug 05 07:31:41.765322 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 622/1257] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:41 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:41.785342 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-19ac49c3-37af-44e9-82fc-9c472db76900 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:31:41.786241 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-19ac49c3-37af-44e9-82fc-9c472db76900 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:41.794062 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-19ac49c3-37af-44e9-82fc-9c472db76900 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:41.794602 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-19ac49c3-37af-44e9-82fc-9c472db76900 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:41.795055 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-19ac49c3-37af-44e9-82fc-9c472db76900 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:41.795777 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-19ac49c3-37af-44e9-82fc-9c472db76900 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:41.796232 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-19ac49c3-37af-44e9-82fc-9c472db76900 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:41.796654 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-19ac49c3-37af-44e9-82fc-9c472db76900 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:41.896879 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-19ac49c3-37af-44e9-82fc-9c472db76900 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117894) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 07:31:41.977658 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-19ac49c3-37af-44e9-82fc-9c472db76900 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "POST /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8/action" status: 202 len: 0 microversion: 2.1 time: 0.196388 Aug 05 07:31:41.978573 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 636/1258] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Aug 5 07:31:41 2022] POST /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 07:31:41.986760 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-daad235d-5371-440c-822d-ab2d0d48cdfb tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:41.987365 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-daad235d-5371-440c-822d-ab2d0d48cdfb tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:41.993596 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-daad235d-5371-440c-822d-ab2d0d48cdfb tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:41.994073 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-daad235d-5371-440c-822d-ab2d0d48cdfb tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:41.994481 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-daad235d-5371-440c-822d-ab2d0d48cdfb tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:41.995188 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-daad235d-5371-440c-822d-ab2d0d48cdfb tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:41.995631 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-daad235d-5371-440c-822d-ab2d0d48cdfb tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:41.996033 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-daad235d-5371-440c-822d-ab2d0d48cdfb tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:42.147980 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-daad235d-5371-440c-822d-ab2d0d48cdfb tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:42.155692 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-daad235d-5371-440c-822d-ab2d0d48cdfb tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1516 microversion: 2.1 time: 0.172914 Aug 05 07:31:42.156314 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 623/1259] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:41 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:43.177792 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c2f5e8da-d5db-4ef7-b67e-191aaec56036 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:43.178405 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c2f5e8da-d5db-4ef7-b67e-191aaec56036 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:43.184806 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c2f5e8da-d5db-4ef7-b67e-191aaec56036 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:43.185306 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c2f5e8da-d5db-4ef7-b67e-191aaec56036 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:43.185764 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c2f5e8da-d5db-4ef7-b67e-191aaec56036 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:43.186455 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c2f5e8da-d5db-4ef7-b67e-191aaec56036 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:43.186930 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c2f5e8da-d5db-4ef7-b67e-191aaec56036 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:43.187352 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c2f5e8da-d5db-4ef7-b67e-191aaec56036 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:43.320648 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c2f5e8da-d5db-4ef7-b67e-191aaec56036 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:43.329500 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c2f5e8da-d5db-4ef7-b67e-191aaec56036 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1518 microversion: 2.1 time: 0.156024 Aug 05 07:31:43.330256 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 637/1260] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:43 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:44.353429 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b1db0186-6c96-42ff-b13b-bce96059e529 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:44.354123 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b1db0186-6c96-42ff-b13b-bce96059e529 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:44.362053 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1db0186-6c96-42ff-b13b-bce96059e529 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:44.362261 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1db0186-6c96-42ff-b13b-bce96059e529 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:44.362624 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1db0186-6c96-42ff-b13b-bce96059e529 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:44.363351 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1db0186-6c96-42ff-b13b-bce96059e529 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:44.363905 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1db0186-6c96-42ff-b13b-bce96059e529 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:44.364190 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b1db0186-6c96-42ff-b13b-bce96059e529 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:44.428131 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-2905f81d-b87a-40b5-93c0-89331fcc17b2 req-7c5ace47-7d55-4f18-926f-933372dbdaff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54a893a-a853-4d14-a8ce-0e35b78295a8", "name": "network-vif-unplugged", "status": "completed", "tag": "55b585c5-4448-4135-aed9-c84f9d38c42b"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:31:44.438684 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-2905f81d-b87a-40b5-93c0-89331fcc17b2 req-7c5ace47-7d55-4f18-926f-933372dbdaff service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:44.439178 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-2905f81d-b87a-40b5-93c0-89331fcc17b2 req-7c5ace47-7d55-4f18-926f-933372dbdaff service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:44.439604 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-2905f81d-b87a-40b5-93c0-89331fcc17b2 req-7c5ace47-7d55-4f18-926f-933372dbdaff service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:44.451356 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-2905f81d-b87a-40b5-93c0-89331fcc17b2 req-7c5ace47-7d55-4f18-926f-933372dbdaff service nova] Creating event network-vif-unplugged:55b585c5-4448-4135-aed9-c84f9d38c42b for instance d54a893a-a853-4d14-a8ce-0e35b78295a8 on hv-cinder-85200 Aug 05 07:31:44.456326 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-2905f81d-b87a-40b5-93c0-89331fcc17b2 req-7c5ace47-7d55-4f18-926f-933372dbdaff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140343 Aug 05 07:31:44.457212 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 624/1261] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 07:31:44.783343 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b1db0186-6c96-42ff-b13b-bce96059e529 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:44.791506 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b1db0186-6c96-42ff-b13b-bce96059e529 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1574 microversion: 2.1 time: 0.442325 Aug 05 07:31:44.792330 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 638/1262] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:44 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1574 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 07:31:45.818401 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2b0f57be-eff2-4f6d-82f6-cdd6334fa69d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:45.819191 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2b0f57be-eff2-4f6d-82f6-cdd6334fa69d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:45.829266 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b0f57be-eff2-4f6d-82f6-cdd6334fa69d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:45.829832 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b0f57be-eff2-4f6d-82f6-cdd6334fa69d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:45.830473 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b0f57be-eff2-4f6d-82f6-cdd6334fa69d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:45.831548 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b0f57be-eff2-4f6d-82f6-cdd6334fa69d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:45.832246 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b0f57be-eff2-4f6d-82f6-cdd6334fa69d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:45.832967 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b0f57be-eff2-4f6d-82f6-cdd6334fa69d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:45.980888 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2b0f57be-eff2-4f6d-82f6-cdd6334fa69d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:45.990416 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2b0f57be-eff2-4f6d-82f6-cdd6334fa69d tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1574 microversion: 2.1 time: 0.179477 Aug 05 07:31:45.991379 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 625/1263] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:45 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:47.014334 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-3fa19544-141d-415d-ad98-bdc3301e6f11 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:47.015135 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-3fa19544-141d-415d-ad98-bdc3301e6f11 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:47.023030 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3fa19544-141d-415d-ad98-bdc3301e6f11 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:47.023623 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3fa19544-141d-415d-ad98-bdc3301e6f11 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:47.024140 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3fa19544-141d-415d-ad98-bdc3301e6f11 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:47.025396 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3fa19544-141d-415d-ad98-bdc3301e6f11 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:47.025920 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3fa19544-141d-415d-ad98-bdc3301e6f11 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:47.026422 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-3fa19544-141d-415d-ad98-bdc3301e6f11 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:47.166339 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-3fa19544-141d-415d-ad98-bdc3301e6f11 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:47.174775 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-3fa19544-141d-415d-ad98-bdc3301e6f11 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1574 microversion: 2.1 time: 0.165165 Aug 05 07:31:47.175341 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 639/1264] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:47 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:48.199913 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c2bf799d-a856-42c6-93ac-f300f7197fed tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:48.200757 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c2bf799d-a856-42c6-93ac-f300f7197fed tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:48.212279 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2bf799d-a856-42c6-93ac-f300f7197fed tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:48.212814 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2bf799d-a856-42c6-93ac-f300f7197fed tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:48.213252 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2bf799d-a856-42c6-93ac-f300f7197fed tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:48.213950 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2bf799d-a856-42c6-93ac-f300f7197fed tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:48.214410 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2bf799d-a856-42c6-93ac-f300f7197fed tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:48.214830 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2bf799d-a856-42c6-93ac-f300f7197fed tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:48.354768 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c2bf799d-a856-42c6-93ac-f300f7197fed tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:48.362764 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c2bf799d-a856-42c6-93ac-f300f7197fed tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1574 microversion: 2.1 time: 0.169184 Aug 05 07:31:48.363336 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 626/1265] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:48 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:49.386309 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-b8c823b7-cfc1-43d3-a21d-ccf893b0cfe7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:49.387128 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-b8c823b7-cfc1-43d3-a21d-ccf893b0cfe7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:49.396211 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b8c823b7-cfc1-43d3-a21d-ccf893b0cfe7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:49.396851 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b8c823b7-cfc1-43d3-a21d-ccf893b0cfe7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:49.397483 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b8c823b7-cfc1-43d3-a21d-ccf893b0cfe7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:49.398405 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b8c823b7-cfc1-43d3-a21d-ccf893b0cfe7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:49.399016 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b8c823b7-cfc1-43d3-a21d-ccf893b0cfe7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:49.399574 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-b8c823b7-cfc1-43d3-a21d-ccf893b0cfe7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:49.541941 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-b8c823b7-cfc1-43d3-a21d-ccf893b0cfe7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:49.552859 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-b8c823b7-cfc1-43d3-a21d-ccf893b0cfe7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1574 microversion: 2.1 time: 0.171686 Aug 05 07:31:49.553664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 640/1266] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:49 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:50.575119 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fe213838-11c3-4719-85e2-7f1f11e4ee72 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:50.575701 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fe213838-11c3-4719-85e2-7f1f11e4ee72 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:50.582611 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fe213838-11c3-4719-85e2-7f1f11e4ee72 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:50.583092 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fe213838-11c3-4719-85e2-7f1f11e4ee72 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:50.583523 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fe213838-11c3-4719-85e2-7f1f11e4ee72 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:50.584217 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fe213838-11c3-4719-85e2-7f1f11e4ee72 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:50.584668 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fe213838-11c3-4719-85e2-7f1f11e4ee72 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:50.585133 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fe213838-11c3-4719-85e2-7f1f11e4ee72 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:50.726227 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fe213838-11c3-4719-85e2-7f1f11e4ee72 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:50.737806 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fe213838-11c3-4719-85e2-7f1f11e4ee72 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1574 microversion: 2.1 time: 0.166714 Aug 05 07:31:50.738595 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 627/1267] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:50 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:51.766779 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-276df2a1-b5fa-4fa7-b2cc-2cec7a268bdc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:51.767443 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-276df2a1-b5fa-4fa7-b2cc-2cec7a268bdc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:51.774345 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-276df2a1-b5fa-4fa7-b2cc-2cec7a268bdc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:51.774832 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-276df2a1-b5fa-4fa7-b2cc-2cec7a268bdc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:51.775259 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-276df2a1-b5fa-4fa7-b2cc-2cec7a268bdc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:51.776029 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-276df2a1-b5fa-4fa7-b2cc-2cec7a268bdc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:51.776489 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-276df2a1-b5fa-4fa7-b2cc-2cec7a268bdc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:51.776887 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-276df2a1-b5fa-4fa7-b2cc-2cec7a268bdc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:51.912131 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-276df2a1-b5fa-4fa7-b2cc-2cec7a268bdc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:51.920349 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-276df2a1-b5fa-4fa7-b2cc-2cec7a268bdc tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1574 microversion: 2.1 time: 0.157608 Aug 05 07:31:51.920953 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 641/1268] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:51 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:52.944881 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8998f604-e2fa-471f-8132-c0532e4ac210 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:52.945536 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8998f604-e2fa-471f-8132-c0532e4ac210 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:52.954003 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8998f604-e2fa-471f-8132-c0532e4ac210 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:52.954486 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8998f604-e2fa-471f-8132-c0532e4ac210 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:52.954919 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8998f604-e2fa-471f-8132-c0532e4ac210 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:52.955614 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8998f604-e2fa-471f-8132-c0532e4ac210 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:52.956047 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8998f604-e2fa-471f-8132-c0532e4ac210 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:52.956494 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8998f604-e2fa-471f-8132-c0532e4ac210 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:53.103932 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8998f604-e2fa-471f-8132-c0532e4ac210 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:53.115535 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8998f604-e2fa-471f-8132-c0532e4ac210 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1574 microversion: 2.1 time: 0.176620 Aug 05 07:31:53.116273 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 628/1269] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:52 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:54.139273 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-519fd047-5365-48cc-bd65-2681176b646b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:31:54.139946 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-519fd047-5365-48cc-bd65-2681176b646b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:31:54.147129 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-519fd047-5365-48cc-bd65-2681176b646b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:54.147693 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-519fd047-5365-48cc-bd65-2681176b646b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:54.148189 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-519fd047-5365-48cc-bd65-2681176b646b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:54.148960 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-519fd047-5365-48cc-bd65-2681176b646b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:54.149412 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-519fd047-5365-48cc-bd65-2681176b646b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:54.149827 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-519fd047-5365-48cc-bd65-2681176b646b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:54.285201 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-519fd047-5365-48cc-bd65-2681176b646b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:31:54.293040 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-519fd047-5365-48cc-bd65-2681176b646b tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1561 microversion: 2.1 time: 0.157751 Aug 05 07:31:54.293639 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 642/1270] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:31:54 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:31:56.438450 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-22c6164d-d8db-41c0-8d54-0bd67edff605 req-4d769059-1327-451d-b725-d94399acaa18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54a893a-a853-4d14-a8ce-0e35b78295a8", "name": "network-vif-plugged", "status": "completed", "tag": "55b585c5-4448-4135-aed9-c84f9d38c42b"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:31:56.448991 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-22c6164d-d8db-41c0-8d54-0bd67edff605 req-4d769059-1327-451d-b725-d94399acaa18 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:31:56.449472 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-22c6164d-d8db-41c0-8d54-0bd67edff605 req-4d769059-1327-451d-b725-d94399acaa18 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:31:56.449949 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-22c6164d-d8db-41c0-8d54-0bd67edff605 req-4d769059-1327-451d-b725-d94399acaa18 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:31:56.461611 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-22c6164d-d8db-41c0-8d54-0bd67edff605 req-4d769059-1327-451d-b725-d94399acaa18 service nova] Creating event network-vif-plugged:55b585c5-4448-4135-aed9-c84f9d38c42b for instance d54a893a-a853-4d14-a8ce-0e35b78295a8 on hv-cinder-85200 Aug 05 07:31:56.466873 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-22c6164d-d8db-41c0-8d54-0bd67edff605 req-4d769059-1327-451d-b725-d94399acaa18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032116 Aug 05 07:31:56.467692 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 629/1271] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:33:22.343869 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:33:22.344621 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG dbcounter [-] [117894] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:33:22.346365 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=28 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:33:22.347603 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:33:22.350576 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-4f7e8e7b-eb7c-4469-9c6f-188b7580c99e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:33:22.351105 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4f7e8e7b-eb7c-4469-9c6f-188b7580c99e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:33:22.358213 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f7e8e7b-eb7c-4469-9c6f-188b7580c99e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:33:22.359065 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f7e8e7b-eb7c-4469-9c6f-188b7580c99e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:33:22.359531 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f7e8e7b-eb7c-4469-9c6f-188b7580c99e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:33:22.360582 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f7e8e7b-eb7c-4469-9c6f-188b7580c99e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:33:22.361271 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f7e8e7b-eb7c-4469-9c6f-188b7580c99e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:33:22.361664 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-4f7e8e7b-eb7c-4469-9c6f-188b7580c99e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:33:22.391325 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-4f7e8e7b-eb7c-4469-9c6f-188b7580c99e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Going to try to terminate instance {{(pid=117894) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 07:33:22.426210 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-4fd4679c-6d65-42ad-b3ff-bdb8af97ee58 req-43c0fdb8-2d1e-47c6-99bd-3c030d1b6260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54a893a-a853-4d14-a8ce-0e35b78295a8", "tag": "55b585c5-4448-4135-aed9-c84f9d38c42b"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:33:22.436935 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4fd4679c-6d65-42ad-b3ff-bdb8af97ee58 req-43c0fdb8-2d1e-47c6-99bd-3c030d1b6260 service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:33:22.437745 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4fd4679c-6d65-42ad-b3ff-bdb8af97ee58 req-43c0fdb8-2d1e-47c6-99bd-3c030d1b6260 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:33:22.438257 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4fd4679c-6d65-42ad-b3ff-bdb8af97ee58 req-43c0fdb8-2d1e-47c6-99bd-3c030d1b6260 service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:33:22.450282 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-4fd4679c-6d65-42ad-b3ff-bdb8af97ee58 req-43c0fdb8-2d1e-47c6-99bd-3c030d1b6260 service nova] Creating event network-changed:55b585c5-4448-4135-aed9-c84f9d38c42b for instance d54a893a-a853-4d14-a8ce-0e35b78295a8 on hv-cinder-85200 Aug 05 07:33:22.455661 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-4fd4679c-6d65-42ad-b3ff-bdb8af97ee58 req-43c0fdb8-2d1e-47c6-99bd-3c030d1b6260 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111691 Aug 05 07:33:22.456408 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 630/1272] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:33:22.474760 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-4f7e8e7b-eb7c-4469-9c6f-188b7580c99e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 204 len: 0 microversion: 2.1 time: 0.133053 Aug 05 07:33:22.475353 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 643/1273] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Aug 5 07:33:22 2022] DELETE /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 07:33:22.484200 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-37d1cd8a-9c6b-445d-9149-201469efc07f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:33:22.484920 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-37d1cd8a-9c6b-445d-9149-201469efc07f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:33:22.491272 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-37d1cd8a-9c6b-445d-9149-201469efc07f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:33:22.491746 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-37d1cd8a-9c6b-445d-9149-201469efc07f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:33:22.492183 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-37d1cd8a-9c6b-445d-9149-201469efc07f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:33:22.492857 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-37d1cd8a-9c6b-445d-9149-201469efc07f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:33:22.493514 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-37d1cd8a-9c6b-445d-9149-201469efc07f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:33:22.493933 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-37d1cd8a-9c6b-445d-9149-201469efc07f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:33:22.634599 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-37d1cd8a-9c6b-445d-9149-201469efc07f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:33:22.642435 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-37d1cd8a-9c6b-445d-9149-201469efc07f tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.162426 Aug 05 07:33:22.643026 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 631/1274] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:33:22 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:33:23.664603 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-c28bd664-f1d4-4d1b-8093-3295fff90162 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:33:23.665333 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-c28bd664-f1d4-4d1b-8093-3295fff90162 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:33:23.672223 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c28bd664-f1d4-4d1b-8093-3295fff90162 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:33:23.672805 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c28bd664-f1d4-4d1b-8093-3295fff90162 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:33:23.673263 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c28bd664-f1d4-4d1b-8093-3295fff90162 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:33:23.673959 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c28bd664-f1d4-4d1b-8093-3295fff90162 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:33:23.674397 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c28bd664-f1d4-4d1b-8093-3295fff90162 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:33:23.674805 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-c28bd664-f1d4-4d1b-8093-3295fff90162 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:33:23.817500 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.policy [None req-c28bd664-f1d4-4d1b-8093-3295fff90162 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117894) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:33:23.825632 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-c28bd664-f1d4-4d1b-8093-3295fff90162 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1567 microversion: 2.1 time: 0.165427 Aug 05 07:33:23.826202 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 644/1275] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:33:23 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:33:24.848479 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9ce4ba44-c1b4-4f19-8781-816f984e23c7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:33:24.849118 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9ce4ba44-c1b4-4f19-8781-816f984e23c7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:33:24.858137 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [req-b9b513a1-b6a6-4b30-ad92-8c183657c131 req-d863d96e-778d-48cd-ba18-7f977c0395df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54a893a-a853-4d14-a8ce-0e35b78295a8", "name": "network-vif-deleted", "tag": "55b585c5-4448-4135-aed9-c84f9d38c42b"}]} {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 07:33:24.858892 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce4ba44-c1b4-4f19-8781-816f984e23c7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:33:24.859371 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce4ba44-c1b4-4f19-8781-816f984e23c7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:33:24.859964 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce4ba44-c1b4-4f19-8781-816f984e23c7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:33:24.860587 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce4ba44-c1b4-4f19-8781-816f984e23c7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:33:24.861141 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce4ba44-c1b4-4f19-8781-816f984e23c7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:33:24.861598 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce4ba44-c1b4-4f19-8781-816f984e23c7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:33:24.869513 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-b9b513a1-b6a6-4b30-ad92-8c183657c131 req-d863d96e-778d-48cd-ba18-7f977c0395df service nova] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:33:24.869992 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-b9b513a1-b6a6-4b30-ad92-8c183657c131 req-d863d96e-778d-48cd-ba18-7f977c0395df service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:33:24.870485 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [req-b9b513a1-b6a6-4b30-ad92-8c183657c131 req-d863d96e-778d-48cd-ba18-7f977c0395df service nova] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:33:24.889598 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.compute.server_external_events [req-b9b513a1-b6a6-4b30-ad92-8c183657c131 req-d863d96e-778d-48cd-ba18-7f977c0395df service nova] Creating event network-vif-deleted:55b585c5-4448-4135-aed9-c84f9d38c42b for instance d54a893a-a853-4d14-a8ce-0e35b78295a8 on hv-cinder-85200 Aug 05 07:33:24.895301 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [req-b9b513a1-b6a6-4b30-ad92-8c183657c131 req-d863d96e-778d-48cd-ba18-7f977c0395df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040987 Aug 05 07:33:24.895989 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 645/1276] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Aug 5 07:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 07:33:24.932717 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9ce4ba44-c1b4-4f19-8781-816f984e23c7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbc21934e84415e93f29aa5073716f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb5b787fed94e7091a4ff793951d8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 07:33:24.941018 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9ce4ba44-c1b4-4f19-8781-816f984e23c7 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 200 len: 1381 microversion: 2.1 time: 0.097929 Aug 05 07:33:24.941634 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 632/1277] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:33:24 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 1381 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 07:33:25.967708 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-db5937ee-bd14-4d88-aa1a-6f78aeb00f2e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '>' {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:33:25.968313 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.compute.api [None req-db5937ee-bd14-4d88-aa1a-6f78aeb00f2e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] [instance: d54a893a-a853-4d14-a8ce-0e35b78295a8] Fetching instance by UUID {{(pid=117894) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 07:33:25.976888 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db5937ee-bd14-4d88-aa1a-6f78aeb00f2e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:33:25.977440 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db5937ee-bd14-4d88-aa1a-6f78aeb00f2e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:33:25.977848 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db5937ee-bd14-4d88-aa1a-6f78aeb00f2e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:33:25.978574 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db5937ee-bd14-4d88-aa1a-6f78aeb00f2e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Acquiring lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 07:33:25.979170 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db5937ee-bd14-4d88-aa1a-6f78aeb00f2e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 07:33:25.979596 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG oslo_concurrency.lockutils [None req-db5937ee-bd14-4d88-aa1a-6f78aeb00f2e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Lock "4447999f-53a9-44bb-be53-fbe9a3e421dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 07:33:25.997475 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.wsgi [None req-db5937ee-bd14-4d88-aa1a-6f78aeb00f2e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] HTTP exception thrown: Instance d54a893a-a853-4d14-a8ce-0e35b78295a8 could not be found. Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-db5937ee-bd14-4d88-aa1a-6f78aeb00f2e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Request method failure captured: Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: request: GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 HTTP/1.1 Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept: application/json Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Accept-Encoding: identity Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Connection: close Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Length: 0 Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Content-Type: application/json Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Host: 10.222.0.27 Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Openstack-System-Scope: None Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: User-Agent: python-urllib3/1.26.11 Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Auth-Token: gAAAAABi7MaFAlQ-zoDJg69TP1r52px5CxK43AGZm6h9JUzcPQz58MC9jyeIqxN_yZUAmQ1DxMrgHwtRcZnjp2c4HmepLxt19ASxnzXqhemb_LScWFwgbBCp-lRJ2mb9Hq8rzAbMlDty20HBb-LywqDn8PDRSymIKlNll2EvjebUHLai6NxoJ6k Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Id: None Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Domain-Name: None Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Identity-Status: Confirmed Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Is-Admin-Project: True Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Id: default Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Domain-Name: Default Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Id: 3cb5b787fed94e7091a4ff793951d8f0 Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Project-Name: tempest-TestShelveInstance-1821581637 Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Role: member,reader Aug 05 07:33:25.999151 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Roles: member,reader Aug 05 07:33:26.001448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3cb5b787fed94e7091a4ff793951d8f0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3cb5b787fed94e7091a4ff793951d8f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3cb5b787fed94e7091a4ff793951d8f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3cb5b787fed94e7091a4ff793951d8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}] Aug 05 07:33:26.001448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant: tempest-TestShelveInstance-1821581637 Aug 05 07:33:26.001448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Id: 3cb5b787fed94e7091a4ff793951d8f0 Aug 05 07:33:26.001448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-Tenant-Name: tempest-TestShelveInstance-1821581637 Aug 05 07:33:26.001448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User: tempest-TestShelveInstance-1821581637-project Aug 05 07:33:26.001448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Id: default Aug 05 07:33:26.001448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Domain-Name: Default Aug 05 07:33:26.001448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Id: 4fbc21934e84415e93f29aa5073716f7 Aug 05 07:33:26.001448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: X-User-Name: tempest-TestShelveInstance-1821581637-project Aug 05 07:33:26.001448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: method: > Aug 05 07:33:26.001448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: exception: Instance d54a893a-a853-4d14-a8ce-0e35b78295a8 could not be found. Aug 05 07:33:26.001448 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: action_args: {'id': 'd54a893a-a853-4d14-a8ce-0e35b78295a8'} Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: {{(pid=117894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d54a893a-a853-4d14-a8ce-0e35b78295a8 could not be found. Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 07:33:26.002782 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d54a893a-a853-4d14-a8ce-0e35b78295a8 could not be found. Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d54a893a-a853-4d14-a8ce-0e35b78295a8 could not be found. Aug 05 07:33:26.004617 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: ERROR nova.api.openstack.wsgi Aug 05 07:33:26.006221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: DEBUG nova.api.openstack.wsgi [None req-db5937ee-bd14-4d88-aa1a-6f78aeb00f2e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Returning 404 to user: Instance d54a893a-a853-4d14-a8ce-0e35b78295a8 could not be found. {{(pid=117894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 07:33:26.006221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO nova.api.openstack.requestlog [None req-db5937ee-bd14-4d88-aa1a-6f78aeb00f2e tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8" status: 404 len: 111 microversion: 2.1 time: 0.041026 Aug 05 07:33:26.006221 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: [pid: 117894|app: 0|req: 646/1278] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Aug 5 07:33:25 2022] GET /compute/v2.1/servers/d54a893a-a853-4d14-a8ce-0e35b78295a8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 07:33:26.180129 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1041639b-a5d1-4423-a00a-1d91363c2d02 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] Calling method '.version_select at 0x7f497270f0d0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 07:33:26.227212 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1041639b-a5d1-4423-a00a-1d91363c2d02 tempest-TestShelveInstance-1821581637 tempest-TestShelveInstance-1821581637-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-598412302" status: 202 len: 0 microversion: 2.1 time: 0.050918 Aug 05 07:33:26.227212 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 633/1279] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Aug 5 07:33:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-598412302 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 07:33:57.743977 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 07:33:57.744665 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Fri Aug 5 07:33:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 07:34:09.556555 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 07:34:09.557794 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Fri Aug 5 07:34:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 07:34:09.851764 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 07:34:09.852366 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Fri Aug 5 07:34:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 07:36:06.304131 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 07:36:06.305005 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Fri Aug 5 07:36:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 07:36:07.170882 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 07:36:07.171736 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Fri Aug 5 07:36:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 07:36:20.592179 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 07:36:20.593074 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Fri Aug 5 07:36:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 07:37:17.754477 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 07:37:17.755426 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Fri Aug 5 07:37:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 07:37:29.570009 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 07:37:29.570009 dv-cinder-852007-1-iscsi devstack@n-api.service[117894]: Fri Aug 5 07:37:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 07:37:29.866574 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 07:37:29.867384 dv-cinder-852007-1-iscsi devstack@n-api.service[117893]: Fri Aug 5 07:37:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!